>I think GPT-3 is a technical marvel but it did not reveal anything about language that wasn't already known by linguists for at least a 100 years. Yet. It's

>I think GPT-3 is a technical marvel but it did not reveal anything about language that wasn't already known by linguists for at least a 100 years. Yet. It's so incredibly sensitive to input conditions I would say that we really don't know exactly how to explore it fully. I would also argue that we don't really understand a single language until we understand many, and until we tag and classify the inputs I would say we don't even really understand what we passed through the system at all.