20 ms·
Was yours an SVG? I think that’s what makes Simon feel that this test is useful: the LLM has to generate functioning SVG code describing these shapes.
by alwa 2y ago
Was yours an SVG? I think that’s what makes Simon feel that this test is useful: the LLM has to generate functioning SVG code describing these shapes.
- simonw 2y agoYeah, this test is to see if a pure LLM can output SVG that renders well. It's effectively a test of their "spatial reasoning" capabilities.
- openrisk 2y agoIts sneakier than that because there are so many ways you can draw the same thing in svg, its also some sort of orchestration and coherence test