Taking existing methods and scaling them up leads to better LLMs. That's a major part of what OpenAI is doing. Now the scaling hypothesis is basically just tha

Taking existing methods and scaling them up leads to better LLMs. That's a major part of what OpenAI is doing. Now the scaling hypothesis is basically just that sophisticated behavior emerges by itself as neural networks get bigger and get trained on more data with more complex problems. LLMs certainly show that so far, but to jump to an AGI I think we need to fix various shortcomings. It's certainly possible that a future version of an LLM will be an AGI, but imho that will also be thanks to current and future improvements like adding an internal dialogue or medium-term memory. Or maybe LLMs just can't scale that far, because experiencing the world through text is insufficient.