He's right, it won't get us to AGI. But scaling is necessary if we ever want to get to AGI. One thing his argument has a point is that we're really close to h

He's right, it won't get us to AGI. But scaling is necessary if we ever want to get to AGI. One thing his argument has a point is that we're really close to hitting a ceiling in improvements for LLMs, unless a new groundbreaking research arrives. Just shoving more data, increasing parameters etc won't get us anywhere. Not to mention LLMs behave more like a data compression algorithm than anyform of "artificial" intelligence. What I personally find troubling is what will happen to NVidia and other pick sellers once the LLM hype fades away and people are aware of its limitations, will we have still big investments in scaling? Likely not.