> What has been will be again, what has been done will be done again; there is nothing new under the sun. Arguably, most everything anyone can encounter has ha

> What has been will be again, what has been done will be done again; there is nothing new under the sun. Arguably, most everything anyone can encounter has happened to someone, and likely been written about. Imagine a toddler learning from everything that has happened everywhere it happened all at once, as recorded in a journal. Now, by contrast, a toddler learning from Discworld. Is that remotely enough? How much is enough? Turns out you can look this up, as it has been graphed: it's rather more than Discworld to get these "emergent" properties. Just as it would be rather more than Discworld before a toddler without our everything journal could make sense of Discworld itself. To your point, before reading Discworld, our toddler would need a great deal of huge chaotic training sets. Stands to reason, so might the LLM.