3 ms·
As far as my understanding goes. It is not a breakthrough model itself but finetuned model with right tools and skills. Fairly similiar to today's coding agents
by hsuduebc2 5mo ago
As far as my understanding goes. It is not a breakthrough model itself but finetuned model with right tools and skills. Fairly similiar to today's coding agents with difference that they are made for software engineering not cyber security.
- ACCount37 5mo agoMythos is the next point on the scaling curve. It has considerably more parameters than most frontier models of today. Which gives it a lot more oomph per token. Is it a "breakthrough" as in "something novel and unexpected"? No. Is it a "breakthrough" as in "something we know works, but made to work on a greater scale"? Very much so.
- hsuduebc2 5mo agoSo it's just a bigger model? Like for example todays 1T models?
- ACCount37 5mo agoSupposedly 10T scale. Literally the next big thing. A bit like what OpenAI tried with GPT-4.5 - but Anthropic actually made it work with MoE, reasoning, tool use, RLVR, etc. It matters because the "g factor" of today's LLMs is at least in part a function of raw scale. Larger models are just smarter - assuming you can handle the training and inference at this increased scale.
- AnimalMuppet 5mo agoSo, realistically, how much further can this go? How many more orders of magnitude?
- ACCount37 5mo ago100T definitely. 1Q maybe. Beyond that, we need new architectures or new types of inference hardware - maybe both. By some estimates, 100T is about what the human brain has when used to its fullest.