3 ms·
But people absolutely have extracted individual source images out of the models by not even particularly careful prompting.
by Marazan 3y ago
But people absolutely have extracted individual source images out of the models by not even particularly careful prompting.
- artifabrian 3y agoThat's absolutely not true. You might get replicas of incredibly popular works like Mona Lisa due to overfitting but that's it. If I am wrong please do provide an example as this is very relevant and interesting (and impossible from an information theory pov).
- Marazan 3y agohttps://www.technologyreview.com/2023/02/03/1067786/ai-models-spit-out-photos-of-real-people-and-copyrighted-images/ https://www.technologyreview.com/2023/02/03/1067786/ai-model... The approach I've seen is to prompt for people with unusual names, they're often be only a single source image in the input data set that gets reproduced by the AI. I've seen examples with the AI "generated" images and the source image side by side - I'll try and find them. EDIT: Link to the paper https://arxiv.org/abs/2301.13188 https://arxiv.org/abs/2301.13188 and this articles has the example images: https://www.theregister.com/2023/02/06/uh_oh_attackers_can_extract/ https://www.theregister.com/2023/02/06/uh_oh_attackers_can_e... Look at the Ann Graham Lotz image and tell me that isn't the source image being reproduced in a lossy manner.