> We've literally NEVER had to contend with tasks of this magnitude before. Many thousands of centuries of human life hours distilled. And one poem or a page o

> We've literally NEVER had to contend with tasks of this magnitude before. Many thousands of centuries of human life hours distilled. And one poem or a page of text is but a drop in this ocean, an infinitesimal contribution. The model is much smaller than the training set. For example Stable Diffusion packs 5B images in 5GB, that's a compression factor of 100,000:1, about 1 byte per training image, not even a pixel. Taking so little from everyone, I am amazed how strong a reaction it creates. The final model doesn't steal almost anything, it doesn't rely on any training example too much, just a compressed abstraction of the training data. You have to overfit it and also prime it to make it regurgitate some training examples, and most attempts fail, resulting in novel outputs.