> What if I finetune GPT-3 ... > if you train a much bigger model on much bigger data... Yep, no one is denying that the potential exists for something to be

> What if I finetune GPT-3 ... > if you train a much bigger model on much bigger data... Yep, no one is denying that the potential exists for something to be created that can do something useful. However, the point being made is that GPT-3 doesn't do anything particularly useful. The generated text from is not consistent, and apparently fine tuning can result in poor performance (ie. generates random crap). It scored better at a bunch of metrics, which is great, but of questionable practical value. "world model" or not, it's currently interesting, amazing... probably not useful unless you're writing a spam bot. What is unclear, is if bigger models will actually solve that or not.