4 ms·
Just tried "generate an SVG of a pelican riding a bicycle" for Claude Opus 4.8 Max and of course both legs on same side ... the smartest publicly available mode
by raffael_de 4mo ago
Just tried "generate an SVG of a pelican riding a bicycle" for Claude Opus 4.8 Max and of course both legs on same side ... the smartest publicly available model by Anthropic (after Fable) doesn't even successfully simulate understanding the concept of a bicycle.
- mountainriver 4mo agoYet it can write code better than 99% of humans… It’s just starting to be trained on svgs, which is a really hard problem
- raffael_de 4mo ago"99% of humans" is a low bar. Maybe you mean "99% of people who earn money by developing software"?
- WarmWash 4mo agoLLMs can't really "see", so I challenge you to draw a pelican on a bike without any visual feedback, just code. Because that is how they are doing it. Vision tokens for transformers aren't really well solved yet, which is why they can smash a phd math problem and trip over a "count the cats on the chair" problem.
- raffael_de 4mo agoIt's not about seeing. It's about identifying the legs of the Pelican and then transferring the concept and mechanics of riding a bicycle + geometry of a body and a bicycle. The entire task has also nothing to do with vision tokens.
- WarmWash 4mo ago> It's about identifying the legs So, seeing?
- raffael_de 4mo agoseeing isn't necessary to understand what a leg is.
- WarmWash 4mo agoWhich I why humans can draw so well with their eyes closed?
- mountainriver 4mo agoIf we want to train a model excessively on SVGs it will obviously be able to do this. We have only just started trying to do that