4 ms·
They’ve ensured the only way to create CSAM is through old-fashioned child exploitation, meanwhile all perfectly humane art and photography is at risk of AI rep
by datalopers 4y ago
They’ve ensured the only way to create CSAM is through old-fashioned child exploitation, meanwhile all perfectly humane art and photography is at risk of AI replacement.
This is a huge missed opportunity to actually help society.
- braingenious 4y agoLMFAO What do you propose? The FBI releases a CSAM data set for devs to use for “training”? Would you be the one to create the model? Would you run a business that sells synthetic CSAM?
- datalopers 4y agoWithout the changes they made to Stable Diffusion, it was already able to generate CP. That's why they restricted it from doing so. It did not have child pornography in the training set, but it did have plenty of normal adult nudity, adult pornography, and plenty of fully clothed children, and was able to extrapolate. Anyway, one obvious application: FBI could run a darknet honeypot site selling AI-generated child porn. Eliminate the actual problem without endangering children.
- braingenious 4y ago
- tick_tock_tick 4y ago> FBI could run a darknet honeypot site selling AI-generated child porn. Eliminate the actual problem without endangering children. It's very unlikely AI generated child porn would even be illegal. Drawn or photoshopped photos aren't so I don't think AI generated would be.
- barrkel 4y agoThis isn't the case in law in many countries. Whether an image is illegal or not does not solely depend on the means of production; if the images are realistic, then they are often illegal. https://en.m.wikipedia.org/wiki/Legal_status_of_fictional_pornography_depicting_minors https://en.m.wikipedia.org/wiki/Legal_status_of_fictional_po... Don't forget that pornographic images and videos featuring children may be used for grooming purposes, socializing children into the idea of sexual abuse. There's a legitimate social purpose in limiting their production.
- snek_case 4y agoStable diffusion is able to draw images of bears wearing spacesuits and penguins playing golf. I don't think it actually needs that kind of input to generate it. It's clearly able to generalize outside of the training set. So... Seems it should be possible to generate that kind of data without people being harmed. That being said, this is a question for sociologists/psychologists IMO. Would giving people with these kinds of tendencies that kind of material make them more or less likely to cause harm? Is there a way to answer that question without harming anybody? In the mean time, stay away from 4chan.
- sroussey 4y agoWell, Microsoft and others have this model for recognizing CSAM, trained on those CSAM images.
- braingenious 4y ago
- PartiallyTyped 4y agoApple, and meta have as well. Apparently Facebook has a huge problem with distribution through messenger.
- bambataa 4y agoOnce I read an article about a guy who got arrested because he’d put child porn on his Dropbox. I had assumed he’d been caught by some more sophisticated means and that was just the public story. I’m amazed that anyone would be stupid enough to distribute CSAM through an account linked to their own name.
- boppo1 4y agoI imagine the problem with messenger is teenagers sexting each other.
- PartiallyTyped 4y agoYou will find very few teenagers in messenger, most use snapchat instead.
- concordDance 4y agoYes to the first and no to the second seem the obvious answers here.
- braingenious 4y ago
- concordDance 4y agoSo your hypothesis is that if the FBI gives the database to a company it will inevitably leak to the pedophile underworld? I can't judge how likely that is. I guess I also don't care much as I only really care aboit stopping production using real children, simulated CSAM gets a shrug and even use of old CSAM only gets a frown.
- braingenious 4y agoWhat company? How is it that people are advocating for the release of this database yet nobody says to whom? My (lol now flagged) opinion is that it’s kind of weird to advocate for the CSAM archive to move into [literally any private company?] to turn it into some sort of public good based on… frowns?
- alignItems 4y agoCSAM is a canary for general AI safety. If we can’t prevent SD from creating CP, will we be able to stop robots from killing people?
- npteljes 4y agoI don't think, and Stability's CEO also doesn't seem to think, that society would receive it as a benefit. Therefore, it's undesirable, right now.