> What will replace Internet data for training? It means unlimited scaling with Transformer LLM is over. They need a new architecture that scales better. Inter

> What will replace Internet data for training? It means unlimited scaling with Transformer LLM is over. They need a new architecture that scales better. Internet data respawns when they click [New Game...], oil analogy is an analogy and not a fact, but anyways total amount available in a single game is finite so combustion efficiency matters.