3 ms·
Both OpenAI and Google used models made specifically for the task, not their general-purpose products. OpenAI: https://xcancel.com/alexwei_/status/194647775673
by yorwba 11mo ago
Both OpenAI and Google used models made specifically for the task, not their general-purpose products.
OpenAI: https://xcancel.com/alexwei_/status/1946477756738629827#m https://xcancel.com/alexwei_/status/1946477756738629827#m "we are releasing GPT-5 soon, and we’re excited for you to try it. But just to be clear: the IMO gold LLM is an experimental research model. We don’t plan to release anything with this level of math capability for several months."
DeepMind: https://deepmind.google/blog/advanced-version-of-gemini-with-deep-think-officially-achieves-gold-medal-standard-at-the-international-mathematical-olympiad/ https://deepmind.google/blog/advanced-version-of-gemini-with... "we additionally trained this version of Gemini on novel reinforcement learning techniques that can leverage more multi-step reasoning, problem-solving and theorem-proving data. We also provided Gemini with access to a curated corpus of high-quality solutions to mathematics problems, and added some general hints and tips on how to approach IMO problems to its instructions."
- simianwords 11mo agoNot true
- simianwords 11mo agohttps://x.com/sama/status/1946569252296929727 https://x.com/sama/status/1946569252296929727 >we achieved gold medal level performance on the 2025 IMO competition with a general-purpose reasoning system! to emphasize, this is an LLM doing math and not a specific formal math system; it is part of our main push towards general intelligence. asterisks mine
- yorwba 11mo agoDeepSeekMath-V2 is also an LLM doing math and not a specific formal math system. What interpretation of "general purpose" were you using where one of them is "general purpose" and the other isn't?
- simianwords 11mo agoThis model can’t be used for say questions on biology or history.
- yorwba 11mo agoHow do you know how well OpenAI's unreleased experimental model does on biology or history questions?
- simianwords 11mo agoSam specifically says it is general purpose and also this > Typically for these AI results, like in Go/Dota/Poker/Diplomacy, researchers spend years making an AI that masters one narrow domain and does little else. But this isn’t an IMO-specific model. It’s a reasoning LLM that incorporates new experimental general-purpose techniques. https://x.com/polynoamial/status/1946478250974200272 https://x.com/polynoamial/status/1946478250974200272
- lossolo 11mo agoYou are overinterpreting what they said again. "Go/Dota/Poker/Diplomacy" do not use LLMs, which means they are not considered "general purpose" by them. And to prove it to you, look at the OpenAI IMO solutions on GitHub, which clearly show that it's not a general purpose trained LLM because of how the words and sentences are generated there. These are models specifically fine tuned for math.
- simianwords 11mo agothey could not have been more clear - sorry but are you even reading?
- lossolo 11mo agoClear about what? Do you know the difference between an LLM based on transformer attention and a monte carlo tree search system like the one used in Go? You do not understand what they are saying. It was a fine tuned model, just as DeepSeekMath is a fine tuned LLM for math, which means it was a special purpose model. Read the OpenAI GitHub IMO submissions to see the proof.