3 ms·
The summarized chain of thought for this task (linked in the blogpost) is 125 pages. That's an insane scale of reasoning, quite akin to what Anthropic has been
by zozbot234 5mo ago
The summarized chain of thought for this task (linked in the blogpost) is 125 pages. That's an insane scale of reasoning, quite akin to what Anthropic has been teasing with Mythos.
- estetlinus 5mo agoToday I generated the equivalent of two LOTR books just to fix three missing rows in my SQL models (and open a PR), so +1
- wayeq 5mo agoor put differently, you melted x cubic meters of polar ice
- FuckButtons 5mo agoBased on some napkin math, that would be about ~100 watt hours of electricity on an H100 cluster, or, roughly the same amount of energy needed to boil a kettle for a cup of tea.
- nhinck2 5mo agoThat's an exceptionally fast output you have there... Mind showing your working out?
- FuckButtons 5mo agoLotr ~1.4k pages 1 page ~1k tok -> ~700k tok 1tok ~0.5J -> 350kJ ~100Wh ~1 cup of tea
- Petersipoi 5mo agoDoing anything melts x cubic meters of polar ice.
- devttyeu 5mo agoThat's here for anyone wondering - https://cdn.openai.com/pdf/1625eff6-5ac1-40d8-b1db-5d5cf925de8b/unit-distance-cot.pdf https://cdn.openai.com/pdf/1625eff6-5ac1-40d8-b1db-5d5cf925d...
- gilgoomesh 5mo agoI'm disappointed only that the chain of thought needed to be rewritten. Need to train these LLMs to natively communicate in LaTeX research paper format.
- bigzyg33k 5mo agoI believe they rewrite the chain of thought to protect their IP, i.e. the chain of thought reveals information about how the model works in a manner that may aid replication
- noobermin 5mo agoSo, I'm not really a mathematician, but the first 3-8 pages reads like nonsense and a bunch of unrelated facts. A bit surreal may be, but if this the norm for this kind of thing, I'm amazed it arrives at any useful result at all.
- chiwilliams 5mo agoIt didn't seem like nonsense to me. (Recently graduated undergrad with a math degree; probably could have gone to PhD). It seemed like the AI was cycling through a bunch of different possible approaches to tackle the problem. Eventually it finds one and makes more progress there until it reaches the solution
- Chamix 5mo agoI note that (though summarized), this is ~100k tokens. Anyone who routinely works with Codex (or any agentic harness really) can tell you how trivial it is to eat up 100k tokens doing complex work. I've personally had plenty of codex 5.5 xhigh sessions where just the pure chain of thought token count in a single turn exceeds 200k (and I assume doesn't go further only due to compaction meta-guidance; the harness will push the model to stay under 256k per turn/thinking block) . I think the more interesting question is how many tokens were spent all told; the most interesting graph in the article imo is the success rate by log test-time compute: how many tokens are being spent on the right of the graph to hit a winning CoT/solution like this >50% of the time?
- stratos123 5mo agoAFAIK, extremely long CoT is fairly routine for those math-finetuned private models. Also, is Mythos unusually verbose compared to Opus?