The internet is just the training data. And there’s plenty to be done to improve the quality of the data. The size of the model determines how well it performs

The internet is just the training data. And there’s plenty to be done to improve the quality of the data. The size of the model determines how well it performs. A bigger model would perform better. We won’t be seeing much bigger models in the immediate future because the 1T models are a good balance of cost and performance.