This doesn’t demonstrate anything in the time dimension. It’s simply saying we don’t know how to do it now, which everybody agrees on. I agree when you say we

This doesn’t demonstrate anything in the time dimension. It’s simply saying we don’t know how to do it now, which everybody agrees on. I agree when you say we have the processing power already. GPT-3 contains way more information than a individual human brain can possibly experience (show me a human who has read Commmon Crawl like a book). The biggest issue currently is the data inefficiency of Transformers. But we don’t know when the big new thing that comes after Transformers will be invented, and we don’t know if it will be enough for AGI or not.