Contrarian Opinion: It doesn't matter one bit. Take a walk down any science museum, and you see a consistent pattern in technology development: people will pus

Contrarian Opinion: It doesn't matter one bit. Take a walk down any science museum, and you see a consistent pattern in technology development: people will push an existing technology to its absolute extreme before they come up with the next clever step. That's GPT-3. It's no holy grail. I find work of the kind that Hugging Face are doing much more interesting, because they are trying to move forward. Their approach is trying to overcome two stumbling blocks for which GPT-3 has no answer: One, that useful language is domain-specific (in the sense that, beyond the written words, it presupposes a familiarity with a world of context). And two, that the way forward is not going big, it's going small. In practically every aspect of historical technology development, the vector for improvement was towards being able to do more with less. These are not the only problem GPT has. Other potholes include its blindness to text structure. This includes logic, and also why it has this rambling incoherent style. So to me, GPT-3 never really crosses over from an academic curio to something that allows us to do something we've not done before. Can it somehow be used to sell EVEN MORE ads? Possibly. Hoorah. But it's not really the milestone the Open AI would like you to believe. (However, if anyone can package Elon Musk's capacity to spin...)