3 ms·
no? it's better on AIME '24, Multilingual MMLU, SWE-bench, Aider’s polyglot, MMMU, ComplexFuncBench and it ties on a lot of benchmarks
by brokensegue 2y ago
no? it's better on AIME '24, Multilingual MMLU, SWE-bench, Aider’s polyglot, MMMU, ComplexFuncBench
and it ties on a lot of benchmarks
- asdev 2y agolook at all the graphs in the article
- brokensegue 2y agothe data i posted all came from the graphs/charts in the article