4 ms·
They reportedly did so to stop people from generating CSAM [0]. [0] https://old.reddit.com/r/StableDiffusion/comments/y9ga5s/stability_ais_take_on_stable_diffu
by satvikpendem 4y ago
They reportedly did so to stop people from generating CSAM [0].
[0] https://old.reddit.com/r/StableDiffusion/comments/y9ga5s/stability_ais_take_on_stable_diffusion_15_and_the/it5kkic/?context=99 https://old.reddit.com/r/StableDiffusion/comments/y9ga5s/sta...
- Gigachad 4y agoNow that's a can of worms I don't think anyone wants to open.
- mysterydip 4y agoSome do, that's the problem.
- randyrand 4y agoArtist have been drawing people of all ages having sex for literally thousands of years. Why should I care about that?
- throwup 4y agoDo pixels have human rights now?
- syockit 4y agoThey don't. The training dataset though, may have been obtained through human rights violation. The problem is when the novelty starts to wear out. Then they will start to look for fresh training data which may again incur more human rights violation. If you can ensure that no new training data are obtained that way, then I guess it's okay? (Personally, I don't condone it)
- Zuiii 4y ago> The problem is when the novelty starts to wear out. Isn't the main feature of stable diffusion is that it doesn't?
- jeroenhd 4y agoOnce again this does pose an interesting problem, though. The AI people claim no copyright issues with the generated issues because AI is different and the training data is not simply recreated. This would also imply that a model released by a paedophile generated out of illegal material would itself not be illegal, as the illegal data is not represented within the model. I very much doubt the police will look at AI this way when such models do eventually hit the web (assuming they haven't already) but at some point someone will get caught through this stuff and the arrest itself may have damning consequences throughout the AI space.
- npteljes 4y agoNo, but people and enterprises have reputation.
- Waterluvian 4y agoI regularly skimmed 4Chan’s /b/ to get a frame of reference for fringe internet culture. But I’ve had to stop because the CSAM they generate by the hundreds per hour is just freakishly and horrifyingly high fidelity. There’s a lot of important social questions to ask about the future of pornography, but I’m sure not going to be the one to touch that with a thousand foot pole.
- selfmodruntime 4y agoThis comment is so far off it might as well be an outright lie. There hasn't been CSAM on /b/ for years. The 4chan you speak of hasn't existed in a decade.
- novatad 4y agoI've spent too many hours there myself, but I haven't seen any AI CSAM, and it's been many years since I witnessed trolls posting the real thing. Moderation (or maybe automated systems) got a lot better at catching that. Now, if you meant gross cartoons, yes, those get posted daily. But there are no children being abused by the creation or sharing of those images, and conflating the two types of image is dishonest.
- boppo1 4y agoThere's more to 4chan than /b/. /diy/, /o/, /k/, etc.
- datalopers 4y agoThey’ve ensured the only way to create CSAM is through old-fashioned child exploitation, meanwhile all perfectly humane art and photography is at risk of AI replacement. This is a huge missed opportunity to actually help society.
- braingenious 4y agoLMFAO What do you propose? The FBI releases a CSAM data set for devs to use for “training”? Would you be the one to create the model? Would you run a business that sells synthetic CSAM?
- datalopers 4y agoWithout the changes they made to Stable Diffusion, it was already able to generate CP. That's why they restricted it from doing so. It did not have child pornography in the training set, but it did have plenty of normal adult nudity, adult pornography, and plenty of fully clothed children, and was able to extrapolate. Anyway, one obvious application: FBI could run a darknet honeypot site selling AI-generated child porn. Eliminate the actual problem without endangering children.
- braingenious 4y ago
- tick_tock_tick 4y ago> FBI could run a darknet honeypot site selling AI-generated child porn. Eliminate the actual problem without endangering children. It's very unlikely AI generated child porn would even be illegal. Drawn or photoshopped photos aren't so I don't think AI generated would be.
- barrkel 4y agoThis isn't the case in law in many countries. Whether an image is illegal or not does not solely depend on the means of production; if the images are realistic, then they are often illegal. https://en.m.wikipedia.org/wiki/Legal_status_of_fictional_pornography_depicting_minors https://en.m.wikipedia.org/wiki/Legal_status_of_fictional_po... Don't forget that pornographic images and videos featuring children may be used for grooming purposes, socializing children into the idea of sexual abuse. There's a legitimate social purpose in limiting their production.
- trafficante 4y agoNixon: (muttering) Jesus Christ I swear every time I find myself thinking “Hey, stop being so cynical and jaded all the time”, I stumble across something like this.
- GaryPalmer 4y agoWhat is the point of making it "as hard as possible" for people? This not a game release. It doesn't matter if it's cracked tommorow or in a year. On open source no less, it's going to happen sooner rather than later. As disgusting as it is but somebody is going to feed CP to an A.I. Model and that's just the reality of it. It's just going to happen one way or another and it's not any of these A.I. Companies fault.
- satvikpendem 4y agoPlausible deniability for governments. It's like DRM for Netflix-like streaming platforms. If they don't add DRM and their content owners' content gets pirated, they could argued in court that Netflix didn't do everything in their power to stop such piracy. So too here for Stability AI, they've said this is their reasoning before.
- BeFlatXIII 4y agoThat's the excuse they all use.