I think the point was that the current transformer model paradigm will never be able to reach AGI, no matter how far you take it. It needs something fundamental

I think the point was that the current transformer model paradigm will never be able to reach AGI, no matter how far you take it. It needs something fundamentally more to be able to do that. But maybe as you say, that something will be built on top of transformer technology.