3 ms·
the model is too small to memorise that much, and papers usually check things like "closest sample from training set" so we know it's not memorising (unless it'
by WithinReason 2y ago
the model is too small to memorise that much, and papers usually check things like "closest sample from training set" so we know it's not memorising (unless it's an image that's hundreds of times in the training set like the Mona Lisa)
- puttycat 2y agoHow do you quantify "by that much"? It can memorize at least some of the images for sure. Potentially these are the images OP was able to recover.
- WithinReason 2y agoWhy would it memorize some but not others if each contributes the same amount of information? E.g. the LAION dataset is about 240TB, while FLUX is about 10GB, so it could only memorize 0.00833333% of each image, not enough to reproduce it.