2 ms·
I think a ton of people see a line going up and they think exponential. When in Reality, the vast majority of the time it’s actually logistic.
by yoyohello13 1y ago
I think a ton of people see a line going up and they think exponential. When in Reality, the vast majority of the time it’s actually logistic.
- tibbar 1y agoGiven the physical limits of the universe and our planet in particular, yeah, this is pretty much always true. The interesting question is: what is that limit, and: how many orders of magnitude are we away from leveling off?
- Ianjit 1y agoFor reasoning the data suggests models are in the logistic domain? Grok 3 - Grok 3 reasoning: 15% increase in training compute for a 25% uplift in inteligence Grok 3 reasoning - Grok 4: 80% increase in training compute for a 15% uplift in inteligence. Inteligence: Source Atrifical Analysis Training Compute: Source https://youtu.be/MtYsUdfZPMA?t=162 https://youtu.be/MtYsUdfZPMA?t=162
- misnome 1y agoI mean the cost line does look somewhat exponential…