4 ms·
It's because Fable is just synthetic RL tasks + scale. The secret has been out for awhile now.
by extr 2mo ago
It's because Fable is just synthetic RL tasks + scale. The secret has been out for awhile now.
- causal 2mo agoDoes not explain timing
- extr 2mo agokeep in mind fable = mythos which as been "done" since february. so the gap is not 2 months, it's more like - techniques probably started "working" in late 2025, now are trickling down to 2nd tier labs 9 months later.
- causal 2mo agoYeah that would make more sense, it's probably a tight community and word gets around when something starts working.
- tintor 2mo agoMaybe because frontier labs buy the same RL tasks from task producer companies.
- behnamoh 2mo agoWho are these task producers? Are you saying that Anthropic, et al delegate the RL part to third party companies that do it for pretty much every other AI company as well?
- ardivekar 2mo agoTuring, etc. And yes.
- adastra22 2mo agoThere are companies that will pay you $$$ for technical challenges that stump frontier models. I’ve met these people. They make good money.
- mike_hearn 1mo agoYes they're called RL gym companies and there's a whole ecosystem of them. You hardly hear about them because their only customers are AI labs and RLVR is where the improvements are coming from at the frontier right now. Note that RLVR is incredibly compute expensive but it's CPU as much as GPU.
- guywithahat 2mo agoYes it does, it just means all the companies come out with similar models around the same time. If what they were doing was completely novel, it would take a long time to repeat. As it is now each company releases a new model every few months, and every couple years the "leading" company changes.
- lossolo 2mo agoThis is basically the answer, they generate A LOT of synthetic task rollouts in parallel, then use RL on the resulting reward signals to improve the model. Add scale to this and you have a Fable class model.