Few short learning performance scales with model size. Afaik they don't see a plateau yet and the race is on the ingest more data and come up with better tuning

Few short learning performance scales with model size. Afaik they don't see a plateau yet and the race is on the ingest more data and come up with better tuning techniques. https://splab.sdu.edu.cn/GPT3.pdf https://splab.sdu.edu.cn/GPT3.pdf