LeCun's reply: > more like a thousand times more. > Between 1 and 2 trillion tokens. > It would take a person 22,000 years to read through 1 trillion words at

LeCun's reply: > more like a thousand times more. > Between 1 and 2 trillion tokens. > It would take a person 22,000 years to read through 1 trillion words at normal speed for 8 hours a day. It's kind of surprising to me that around 1000 humans could feasibly read the whole internet (as scraped for LLMs) between each other in only 22 years. The internet feels so much more massive than that. Though of course lots of the stuff on arxiv etc. is so dense there is no way you go through it at normal reading speed.