3 ms·
A bit important that this model is not general purpose whereas the ones Google and OpenAI used were general purpose.
by simianwords 11mo ago
A bit important that this model is not general purpose whereas the ones Google and OpenAI used were general purpose.
- mangolie 11mo agohttps://x.com/deepseek_ai/status/1995452646459858977 https://x.com/deepseek_ai/status/1995452646459858977 Boom
- simianwords 11mo agoOh you may be correct. Are these models general purpose or fine tuned for mathematics?
- yorwba 11mo agoThat's a different model: https://huggingface.co/deepseek-ai/DeepSeek-V3.2-Speciale https://huggingface.co/deepseek-ai/DeepSeek-V3.2-Speciale
- andy12_ 11mo agoDo note that that is a different model. The one we are talking about here, DeepSeekMath-V2, is indeed overcooked with math RL. It's so eager to solve math problems, that it even comes up with random ones if you prompt it with "Hello". https://x.com/AlpinDale/status/1994324943559852326?s=20 https://x.com/AlpinDale/status/1994324943559852326?s=20
- yorwba 11mo agoBoth OpenAI and Google used models made specifically for the task, not their general-purpose products. OpenAI: https://xcancel.com/alexwei_/status/1946477756738629827#m https://xcancel.com/alexwei_/status/1946477756738629827#m "we are releasing GPT-5 soon, and we’re excited for you to try it. But just to be clear: the IMO gold LLM is an experimental research model. We don’t plan to release anything with this level of math capability for several months." DeepMind: https://deepmind.google/blog/advanced-version-of-gemini-with-deep-think-officially-achieves-gold-medal-standard-at-the-international-mathematical-olympiad/ https://deepmind.google/blog/advanced-version-of-gemini-with... "we additionally trained this version of Gemini on novel reinforcement learning techniques that can leverage more multi-step reasoning, problem-solving and theorem-proving data. We also provided Gemini with access to a curated corpus of high-quality solutions to mathematics problems, and added some general hints and tips on how to approach IMO problems to its instructions."
- simianwords 11mo agoNot true
- simianwords 11mo agohttps://x.com/sama/status/1946569252296929727 https://x.com/sama/status/1946569252296929727 >we achieved gold medal level performance on the 2025 IMO competition with a general-purpose reasoning system! to emphasize, this is an LLM doing math and not a specific formal math system; it is part of our main push towards general intelligence. asterisks mine
- yorwba 11mo agoDeepSeekMath-V2 is also an LLM doing math and not a specific formal math system. What interpretation of "general purpose" were you using where one of them is "general purpose" and the other isn't?
- simianwords 11mo agoThis model can’t be used for say questions on biology or history.
- yorwba 11mo agoHow do you know how well OpenAI's unreleased experimental model does on biology or history questions?
- simianwords 11mo agoSam specifically says it is general purpose and also this > Typically for these AI results, like in Go/Dota/Poker/Diplomacy, researchers spend years making an AI that masters one narrow domain and does little else. But this isn’t an IMO-specific model. It’s a reasoning LLM that incorporates new experimental general-purpose techniques. https://x.com/polynoamial/status/1946478250974200272 https://x.com/polynoamial/status/1946478250974200272