3 ms·
It's weird that Opus4 is the worst at one-shot, it requires on average two attempts to generate a valid query. If a model is really that much smarter, shouldn'
by XCSme 1y ago
It's weird that Opus4 is the worst at one-shot, it requires on average two attempts to generate a valid query.
If a model is really that much smarter, shouldn't it lead to better first-attempt performance? It still "thinks" beforehand, right?
- riwsky 1y agoDon’t talk to Opus before it’s had its coffee. Classic high-performer failure mode.