4 ms·
> OpenAI knowing how to build AGI and similar outlandish claims. The fact that the scaling of pretrained models is hitting a wall doesn't invalidate any of tho
by diego_sandoval 2y ago
> OpenAI knowing how to build AGI and similar outlandish claims.
The fact that the scaling of pretrained models is hitting a wall doesn't invalidate any of those claims. Everyone in the industry is now shifting towards reasoning models (a.k.a. chain of thought, a.k.a. inference time reasoning, etc.) because it keeps scaling further than pretraining.
Sam said the phrase you refer to [1] in January, when OpenAI had already released o1 and was preparing to release o3.
[1] https://blog.samaltman.com/reflections https://blog.samaltman.com/reflections