2 ms·
Are you sure this is not specialized to IMO? I do see the twitter thread saying it's "general reasoning" but I'd imagine they RL'd on olympiad math questions? I
by Davidzheng 1y ago
Are you sure this is not specialized to IMO? I do see the twitter thread saying it's "general reasoning" but I'd imagine they RL'd on olympiad math questions? If not I really hope someone from OpenAI says that bc it would be pretty astounding.
- stingraycharles 1y agoThey also said this is not part of GPT-5, and “will be released later”. It’s very, very likely a model specifically fine-tuned for this benchmark, where afterwards they’ll evaluate what actual real-world problems it’s good at (eg like “use o4-mini-high for coding”).
- UltraSane 1y agoHumans who excel at IMO questions are also "fine tuned" on them in the sense that they practice them for hundreds of hours
- SiempreViernes 1y agoSure, but nobody is using their IMO score to prove they are superintelligent and pulling it off in wider groups.
- wanderlust123 1y agoI’m pretty sure that a high score in imo is a sign of high intelligence.
- UltraSane 1y agoAnd the opposite of ADHD.
- sebmellen 1y agoI’ve seen IMO rank used to justify more than one $100m+ seed round.
- htrp 1y agoSomeone was burned by Cognition?
- Jensson 1y agoTheir hardware isn't fine tuned to it though, it uses the same general intelligence hardware that all other humans use. So its a big difference if you use a general intelligence system and makes it do well in math, or when you create a specialized system that is only good at math and can't be used to get good in other areas.
- UltraSane 1y agoThis IMO LLM isn't using fine tuned hardware either.