7 ms·
100% on the AIME (assuming its not in the training data) is pretty impressive. I got like 4/15 when I was in HS...
by varenc 10mo ago
100% on the AIME (assuming its not in the training data) is pretty impressive. I got like 4/15 when I was in HS...
- hellojimbo 10mo agoThe no tools part is impressive, with tools every model gets 100%
- varenc 10mo agoIf I recall, the AIME answers are always 4 digits numbers. And most of the problems are of the type where if you have a candidate number it's reasonable to validate its correctness. So easy to brute force all 4 digit ints with code. tl;dr; humans would do much better too if they could use programming tools :)
- Davidzheng 10mo agouh no it's not solved by looping over 4 digit numbers when it uses tools