I guess AGI will come from identifying and grinding away limitations of transformers (and/or diffusion networks). As it has been with almost all technologies. T

I guess AGI will come from identifying and grinding away limitations of transformers (and/or diffusion networks). As it has been with almost all technologies. Then someone (or someAI) will probably find something unexpected (but less unexpected at this stage) and more suitable for general intelligence.