In November and December 2025, inspired by Simon Willison’s pelican-riding-a-bicycle benchmark, I had then-current LLMs create SVGs from thirty similar prompts, such as “Generate an SVG of an octopus operating a pipe organ.” Simon mentioned that experiment on his blog [1].

Nine months have passed and much stronger models have been released, so I tried the experiment again today. The linked site shows the results. Running ten of the prompts through six models at OpenRouter cost about twenty dollars, so I stopped there for now.

[1] https://simonwillison.net/2025/Nov/25/

Comments URL: https://news.ycombinator.com/item?id=49696402 Points: 77 # Comments: 29