5 ms·
The only table where they showed comparisons against Opus 4.5 and Gemini 3: https://x.com/OpenAI/status/1999182104362668275 https://x.com/OpenAI/status/1999182
by Tiberium 10mo ago
The only table where they showed comparisons against Opus 4.5 and Gemini 3:
https://x.com/OpenAI/status/1999182104362668275 https://x.com/OpenAI/status/1999182104362668275
https://i.imgur.com/e0iB8KC.png https://i.imgur.com/e0iB8KC.png
- varenc 10mo ago100% on the AIME (assuming its not in the training data) is pretty impressive. I got like 4/15 when I was in HS...
- hellojimbo 10mo agoThe no tools part is impressive, with tools every model gets 100%
- varenc 10mo agoIf I recall, the AIME answers are always 4 digits numbers. And most of the problems are of the type where if you have a candidate number it's reasonable to validate its correctness. So easy to brute force all 4 digit ints with code. tl;dr; humans would do much better too if they could use programming tools :)
- Davidzheng 10mo agouh no it's not solved by looping over 4 digit numbers when it uses tools