Yeah I mean technically GPT 3 was already out for a while and looked impressive, but it was still only accesible to like 10 people and it was difficult to tell

Yeah I mean technically GPT 3 was already out for a while and looked impressive, but it was still only accesible to like 10 people and it was difficult to tell if it fell flat outside prearranged demo examples. In fact given what we know now, it likely wasn't nearly as good as it looked. So was hard to say at that point if this whole language model thing will pan out or become yet another useless learning approach that's unfeasible to apply to anything.