This one [1]? That tracks two distinct versions (0613 vs. 0314). Also, IMO, the tasks they evaluate aren't useful (I rarely want my LLM to tell me whether 1707

This one [1]? That tracks two distinct versions (0613 vs. 0314). Also, IMO, the tasks they evaluate aren't useful (I rarely want my LLM to tell me whether 17077 is a prime number), and there's room for cherrypicking/survivorship bias. My guess is that OpenAI did something between 0314 and 0613 that shifted focus away from maths to other subjects. [1] https://arxiv.org/pdf/2307.09009.pdf https://arxiv.org/pdf/2307.09009.pdf