5 ms·
Those output examples are absolutely horrifically bad compared to what I get with a cursory request to Gemini 2.0 using Imagen3 via gemini.google.com.
by eitally 2y ago
Those output examples are absolutely horrifically bad compared to what I get with a cursory request to Gemini 2.0 using Imagen3 via gemini.google.com.
- toxik 2y agoThis is generating SVG data, not using an image generator.
- alwa 2y agoWas yours an SVG? I think that’s what makes Simon feel that this test is useful: the LLM has to generate functioning SVG code describing these shapes.
- simonw 2y agoYeah, this test is to see if a pure LLM can output SVG that renders well. It's effectively a test of their "spatial reasoning" capabilities.
- openrisk 2y agoIts sneakier than that because there are so many ways you can draw the same thing in svg, its also some sort of orchestration and coherence test