Scaling "still works" for increasingly smaller improvements for increasing higher infrastructure costs. As it was obvious from the start, transformers are not

Scaling "still works" for increasingly smaller improvements for increasing higher infrastructure costs. As it was obvious from the start, transformers are not the path to AGI, if there's one.