1. I'd wager AI models will begin to learn via interacting with the world rather than just reading lots of text. That will reduce the need for a huge corpus of

1. I'd wager AI models will begin to learn via interacting with the world rather than just reading lots of text. That will reduce the need for a huge corpus of training data. 2. More efficient methods of training and running LLMs are emerging at an exponential rate 3. There's already enough data to train an AGI. 4. Transformer architecture isn't that old