3 ms·
> like proof that diffusion models memorize heavily repeated training examples being used as evidence they aren't creating stuff at all and just copy pasting T
by MacsHeadroom 4y ago
> like proof that diffusion models memorize heavily repeated training examples being used as evidence they aren't creating stuff at all and just copy pasting
This proof actually demonstrated the opposite. In that paper it was found that something like only 11 pictures from millions were recoverable. They were only recoverable because those handful of pictures were accidentally duplicated in the training data many multiples more than other pictures. Even pictures which were accidentally duplicated dozens of times were found to be unrecoverable by the trained model.