4 ms·

I would expect the benchmark scores to be nonlinear near the top, as the easier tasks get solved and the harder ones are left over. So going from 10 to 15 would

by nsingh2 1mo ago

I would expect the benchmark scores to be nonlinear near the top, as the easier tasks get solved and the harder ones are left over. So going from 10 to 15 would be easier than going from 60 to 65. I only take the Intelligence Index value roughly though. Considering they put Opus 5 (High) at the same level as Fable 5 (Max), I don't trust it that much.

monkpit 1mo ago
> Considering they put Opus 5 (High) at the same level as Fable 5 (Max), I don't trust it that much. Have you used both? I’ve never experienced any seemingly greater level of intelligence from Fable 5 over Opus.