3 ms·
Matches my experience in general as well. I find benchmarks largly useless for comparing current models. Many, despite improved metrics, are strictly worse tha
by Grimblewald 1y ago
Matches my experience in general as well. I find benchmarks largly useless for comparing current models. Many, despite improved metrics, are strictly worse than predecessors. What little gains they show in some areas, like agentic use here, are often set by far broader and often catastrophic losses.