3 ms·
This seems like a case of reversion to the mean. When one model is performing below average, changing anything (like switching to another model) is likely to im
by gpm 1y ago
This seems like a case of reversion to the mean. When one model is performing below average, changing anything (like switching to another model) is likely to improve it by random chance...
- keeeba 1y agoAnthropic say Opus is better, benchmarks & evals say Opus is better, Opus has more parameters and parameters determine how much a NN can learn. Maybe Opus just is better
- deleted 1y ago[deleted]
- 8n4vidtmkvmk 1y agoEven if it's better on average, doesn't mean it's better for every possible query