It is not entirely clear how it would be correct to calculate the amount of data required by a human language center to learn that much. Do you count all the ra

It is not entirely clear how it would be correct to calculate the amount of data required by a human language center to learn that much. Do you count all the random thoughts in someone's mind? What if those thoughts, and also some subconscious processess are constantly running in that network? Input to the human (like audible words said in front of them), and input to the network (whatever data that part of the brain receives from anywhere, both from outside but also from other parts of the brain) are two very distinct things. > gives humans a durable advantage over GPT-3-like approaches. I think it is pretty clear to everyone involved that there are, empirically, so far, numerous very important and obvious and deep advantages that humans have over a GPT-3. This doesn't mean that GPT-2/3 aren't a tremendous achievement in AI.