>1-2 trillion tokens of training for gptx class models >It would take 20 years for a human to read that many tokens at 8 hrs of reading per day Normal reading

>1-2 trillion tokens of training for gptx class models >It would take 20 years for a human to read that many tokens at 8 hrs of reading per day Normal reading is ~200 words per minute. That's 12,000 words per hour. That's 288,000 words per day (reading for 24 hours straight). That's 105,120,000 words per year. That's 2,102,400,000 words per 20 years. A trillion is 1,000,000,000,000.