4 ms·

Isn't it awful ? After 5.5 versions it still can't draw a basic bike frame. How is the front wheel supposed to turn sideways ?

simonw 6mo ago
Yeah, the bike frame is the thing I always look at first - it's still reasonably rare for a model to draw that correctly, although Qwen 3.6 and Gemini Pro 3.1 do that well now.
loa_in_ 6mo ago
The distinction is that it's not drawing. It's generating an SVG document containing descriptors of the shapes.
jetrink 6mo ago
I feel like if I attempted this, the bike frame would look fine and everything else would be completely unrecognizable. After all, a basic bike frame is just straight lines arranged in a fairly simple shape. It's really surprising that models find it so difficult, but they can make a pelican with panache.
- fragmede 6mo ago
  My question is, as a human, how well would you or I do under the same conditions? Which is to say, I could do a much better job in inkscape with Google images to back me up, but if I was blindly shitting vectors into an XML file that I can't render to see the results of, I'm not even going to get the triangles for the frame to line up, so this pelican is very impressive!
- necubi 6mo ago
  Humans are also famously bad at drawing bicycles from memory https://www.gianlucagimini.it/portfolio-item/velocipedia/ https://www.gianlucagimini.it/portfolio-item/velocipedia/
  - deleted 6mo ago
    [deleted]
- nlawalker 6mo ago
  > a fairly simple shape Bike frames are very hard to draw unless you've already consciously internalized the basic shape, see https://www.booooooom.com/2016/05/09/bicycles-built-based-on-peoples-attempts-to-draw-them-from-memory/ https://www.booooooom.com/2016/05/09/bicycles-built-based-on...
- billywhizz 6mo ago
  why do you find it surprising? these models have no actual understanding of anything, never mind the physical properties and capabilities of a bicycle.
  - rimliu 6mo ago
    Sad to see this downvoted. So many people think that LLM have understanding?

simonw 6mo ago

Yeah, the bike frame is the thing I always look at first - it's still reasonably rare for a model to draw that correctly, although Qwen 3.6 and Gemini Pro 3.1 do that well now.

loa_in_ 6mo ago

The distinction is that it's not drawing. It's generating an SVG document containing descriptors of the shapes.

jetrink 6mo ago

I feel like if I attempted this, the bike frame would look fine and everything else would be completely unrecognizable. After all, a basic bike frame is just straight lines arranged in a fairly simple shape. It's really surprising that models find it so difficult, but they can make a pelican with panache.

fragmede 6mo ago
My question is, as a human, how well would you or I do under the same conditions? Which is to say, I could do a much better job in inkscape with Google images to back me up, but if I was blindly shitting vectors into an XML file that I can't render to see the results of, I'm not even going to get the triangles for the frame to line up, so this pelican is very impressive!
necubi 6mo ago
Humans are also famously bad at drawing bicycles from memory https://www.gianlucagimini.it/portfolio-item/velocipedia/ https://www.gianlucagimini.it/portfolio-item/velocipedia/
- deleted 6mo ago
  [deleted]
nlawalker 6mo ago
> a fairly simple shape Bike frames are very hard to draw unless you've already consciously internalized the basic shape, see https://www.booooooom.com/2016/05/09/bicycles-built-based-on-peoples-attempts-to-draw-them-from-memory/ https://www.booooooom.com/2016/05/09/bicycles-built-based-on...
billywhizz 6mo ago
why do you find it surprising? these models have no actual understanding of anything, never mind the physical properties and capabilities of a bicycle.
- rimliu 6mo ago
  Sad to see this downvoted. So many people think that LLM have understanding?