3 ms·
Has it been demonstrated that there is illegal CSAM in the DALL-E training?
by simonw 3y ago
Has it been demonstrated that there is illegal CSAM in the DALL-E training?
- candiodari 3y agoWhy would you need to? Obviously generalizing over pictures of humans and pictures of porn will enable CSAM generation ... Plus a LOT of things have been declared illegal pornographic material in various places: all porn (China), drawn CSAM, any kind of drawn porn with unclear ages, ...
- simonw 3y ago> "Why would you need to?" If someone is going to suggest that there is "illegal child pornography in DALL-E's training data" I think it needs to be backed up - that's a pretty big accusation.
- jsheard 3y agoI don't think it has, if only because OpenAI aren't transparent about where they get their image training data from, but the most widely used public image generation dataset was found to contain CSAM: https://www.theverge.com/2023/12/20/24009418/generative-ai-image-laion-csam-google-stability-stanford https://www.theverge.com/2023/12/20/24009418/generative-ai-i...
- nicklecompte 3y agoIt hasn't been demonstrated in DALL-E, but this was a problem in older OpenAI text-video models, and it's in plenty of CommonCrawl/etc data. There is anecdata from contractors suggesting that DALL-E generated CSAM imagery during RLHF, which is circumstantial evidence that similar images are somewhere in the training data. I think it's fair to say we can't rely on OpenAI's technical competence to remove this stuff from their training data, despite claims to the contrary w.r.t DALL-E 2. (Likewise it seems Copilot Designer churns out CSAM like candy.) Your attitude is naive and competely at odds with (honest) AI safety research. The rational thing for users is to assume DALL-E 2 is contaminated by CSAM unless OpenAI can publicly demonstrate otherwise. Their leadership is too stupid and dishonest for people to take their word. https://ieeexplore.ieee.org/abstract/document/9423393 https://ieeexplore.ieee.org/abstract/document/9423393 https://arxiv.org/pdf/2110.01963.pdf?trk=public_post_comment-text https://arxiv.org/pdf/2110.01963.pdf?trk=public_post_comment... https://www.theguardian.com/technology/2023/aug/02/ai-chatbot-training-human-toll-content-moderator-meta-openai https://www.theguardian.com/technology/2023/aug/02/ai-chatbo...
- simonw 3y agoYou're saying my attitude is "naive". I'm saying that it's irresponsible for you to state that there is CSAM in DALL-E's training data unless you can back that up. I find OpenAI's refusal to document what's in the training data infuriating, but I that doesn't lead me to assume they weren't able to filter out CSAM from it. If they don't care about this issue at all, why are they exposing low paid workers in Kenya to these conditions?