4 ms·
I don't think this small amount generalization to other animals and vehicles is strong evidence they haven't trained on this, either directly or more generally.
by unholiness 2mo ago
I don't think this small amount generalization to other animals and vehicles is strong evidence they haven't trained on this, either directly or more generally.
- conception 2mo agoHonest question how could they possibly train on this as there are no good SVG pelicans to train off right? So they’re just training off a bunch of bad ones which should lead to just bad pelicans, but the pelicans are getting better.
- alexthehurst 2mo agoIt’s not hard for a visual model to score the quality of that output though, which would be a pretty good fitness function.
- retinaros 2mo agoI did that. This works to some extent but why bother. Sft brings you 99,9% there already. Rl helps more with syntax errors. Svg is code
- unholiness 2mo agoTraining on generating SVGs directly at all is already fairly niche. Generating full scenes with a cartoony character is even nicher. But there's plenty of non-pelican cartoony SVG content out there (created, not written, by humans with vector design tools), and more importantly, plenty of vision models to give feedback on the output (just raster as a png). You could easily hill climb this niche skill, if you cared.
- raincole 2mo agoThey can easily afford 1000 human made pelican svg files if they want. I think you underestimate how much resources SotA AI companies have. (I'm not saying that they did that. I'm just saying they can.)