3 ms·
These results don’t just contradict more serious benchmarks, they are wrong on an entirely different axis. This is a saturated benchmark. Haiku gets 96%. The re
by seizethecheese 2mo ago
These results don’t just contradict more serious benchmarks, they are wrong on an entirely different axis. This is a saturated benchmark. Haiku gets 96%. The results here are “not even wrong” and this being #1 on HN right now is a massive smell of either bots or massive ignorance or both.
- urams 2mo agoPeople REALLY want the open models to be better than the frontier labs'.
- geek_at 2mo agoinvestors REALLY want the closed models to stay frontier forevery. mmw the future of AI will be local and offline
- ed-is-ai 2mo agoRead the benchmark - it's on the basis of being 'good enough' for everyday tasks. Which is what fits most applications right. This is not a benchmark for testing them against an Einstein.