You're also incorrect, although less wrong than OP. 45TB was the starting point (the Common Crawl snapshots, mostly). The actual amount of plain text fed in is

You're also incorrect, although less wrong than OP. 45TB was the starting point (the Common Crawl snapshots, mostly). The actual amount of plain text fed in is much smaller, they filtered it down to like 500GBish and then didn't even train a full epoch. (The data scaling law is also favorable, so the dataset doesn't need to grow much even for much larger smarter models.)