Yeah this is the opposite, they did impressively well with fewer parameters. In general larger models and more data has been an effective strategy for getting

Yeah this is the opposite, they did impressively well with fewer parameters. In general larger models and more data has been an effective strategy for getting better performance but getting the right ratio is also important: https://www.deepmind.com/publications/an-empirical-analysis-of-compute-optimal-large-language-model-training https://www.deepmind.com/publications/an-empirical-analysis-...