4 ms·
According to Ilya Sutskever: "results from scaling up pre-training have plateaued". https://www.reuters.com/technology/artificial-intelligence/openai-rivals-se
by elforce002 2y ago
According to Ilya Sutskever: "results from scaling up pre-training have plateaued".
https://www.reuters.com/technology/artificial-intelligence/openai-rivals-seek-new-path-smarter-ai-current-methods-hit-limitations-2024-11-11/ https://www.reuters.com/technology/artificial-intelligence/o...
They're trying other techniques to improve what we already have atm.
- luckydata 2y agoand we plow through plateaus every 6 months, regularly, by inventing something new. I thought we were engineers, not some kind of amish cult.