4 ms·
Recently tried the pelican test on GPT-OSS which was probably one of the best local models of 2025. So cool to see how models have improved in the SVG pelican!
by tarruda 3mo ago
Recently tried the pelican test on GPT-OSS which was probably one of the best local models of 2025. So cool to see how models have improved in the SVG pelican!
- pelagicAustral 3mo agoI'm skeptical, as tests go, I think that's burned out now. They could easily be training specifically to get a better pelican...
- gbalduzzi 3mo agoIf they were training specifically for it the result would be much better
- flir 3mo agoDoesn't have to be specific training, just has to consume simonw's blog. It's got lots of SVG pelicans, with helpful commentary on how good they are. I think there might be some kind of hill climbing going on here.
- rurban 3mo agoGPT-OSS was by far the worst local model in 2026. I have the luxury of plenty of H100's to try them, and Gpt-oss was atrocious with a coding agent. Gemma4 and Deepseek 4 are the best for coding, Qwen for images.