3 ms·
The pelican is really getting old as an a standalone evaluation metric. By now they are certainly going to be in training set if not explicitly tuned to produce
by teruakohatu 6mo ago
The pelican is really getting old as an a standalone evaluation metric. By now they are certainly going to be in training set if not explicitly tuned to produce it for the press on HN alone.
Keep the pelican but isn’t it time to add something else more novel that all current and past models struggle with?
- justinclift 6mo agoRelevant: https://news.ycombinator.com/item?id=47839493 https://news.ycombinator.com/item?id=47839493
- caseyf7 6mo agoIt also seems like all of the models have converged on very similar images.
- whywhywhywhy 6mo agoOne shot canvas and svg images or animations are also just something that at this scale shouldn't be an issue at all, even Qwen running locally on 24gb cards can do impressive ones. Don't understand why this test gets any attention, I mean other than the pelicans which isn't a good test, theres no meat in this article.
- Mashimo 6mo agoAnd yet, look at the French one. Can't compete with one year old open weight models even though they just released a new model this week.