GPT3's input is something like 45TB of data. It's a significant fraction of all text humans ever produced, to the point researches are concerned we may run out

GPT3's input is something like 45TB of data. It's a significant fraction of all text humans ever produced, to the point researches are concerned we may run out of text within the next few years. Normal healthy language exposure for children is around 100KB/day, we can round up to 40MB/year. No, I have not spent ~1000000 years around a baby.