3 ms·
The average scores of high-school students who take AMC and AIME are around 35+-% [1]. "We achieved a new state-of-the-art (41.2% vs 29.3%) on the miniF2F benc
by nopinsight 5y ago
The average scores of high-school students who take AMC and AIME are around 35+-% [1].
"We achieved a new state-of-the-art (41.2% vs 29.3%) on the miniF2F benchmark, a challenging collection of high-school olympiad problems." [2]
This system's performance is already better than the average scores of students who take these tests, who are usually very good at math.
The test/validation sets are drawn from AMC, AIME, and IMO which are competitive math competitions at the high school level (IMO being the hardest). Even though the topics are generally limited to high school curriculum, solving the problems often requires a degree of creative thinking and knowledge synthesis such that many/most college graduates cannot solve them.
[1] https://amc-reg.maa.org/reports/generalreports.aspx https://amc-reg.maa.org/reports/generalreports.aspx
[2] https://openai.com/blog/formal-math/ https://openai.com/blog/formal-math/