3 ms·
At the end of the paper they mention "two problems from the 2025 MIT Integration Bee qualifying exam which the system continued to answere incorrectly". They s
by thomasahle 2y ago
At the end of the paper they mention "two problems from the 2025 MIT Integration Bee qualifying exam which the system continued to answere incorrectly".
They say the questions were among the most complex questions on the exam, but the first one is just
∫ ∛(x · ∜(x · ∜(x · √(x · √(x · ⋯ ))))) dx
which just requires you to compute
1/3 + 1/(3*4) + 1/(3*4*5) + ...
So hardly very advanced math.
- Workaccount2 2y agoIt's a 7B model. So while the problem is not advanced the model is far from it too.
- johntb86 2y agoI'd be curious what would happen if you SFTed a larger model with successful reasoning traces from the smaller model. Would it pick up the overall reasoning pattern, but be able to apply it to more cases?