10 ms·
They apparently tried to combat NSFW generation by filtering the training dataset not to include any.
by rogers18445 4y ago
They apparently tried to combat NSFW generation by filtering the training dataset not to include any.
- throwup 4y agoYou can generate all the bloody violent gore you like, but god forbid anybody see a human body in its natural state
- argella 4y agoBummer. AI porn is fun.
- deleted 4y ago[deleted]
- Gigachad 4y agoThe future is probably models trained almost exclusively on porn.
- joshspankit 4y agoPorn has driven many tech advances. I predict that models trained on specific porn genres will appear as soon as training a good model is doable for under $5000. They’ll get here much quicker if we get video to that mark first.
- snek_case 4y agoYou could probably already get people to pay for a subscription to generate images. Wouldn't be surprised if someone is already working on it.
- rfoo 4y agoThe entire NovelAI drama had already demonstrated this.
- moron4hire 4y ago> Porn has driven many tech advances. This is an urban myth.
- Godel_unicode 4y agoWhich happens to be true.
- deleted 4y ago[deleted]
- feelandcoffee 4y agoYes and now. Yeah the VHS VS Beta situation was exaggerated, but you'll be surprised on how much on Netflix, and youtube UI tricks were stolen from innovation made in adult sites. I'll even say that the high bandwidth push in the public was highly related to that. Even HTML5 video players, adult websites were faster to implement it than big streaming websites that still used flash or similar tech.
- the_shivers 4y agoWhat tech advances would those be?
- fragmede 4y agoprint magazine, cinema, VHS, Internet
- tempthrowaway11 4y agoThey’re already out there, although they’re hard to find via Google - people are doing wild things like “merging” hentai models with models trained on real life porn to get realistic poses and lighting with impossible anatomy. The scary thing is that you can then train it further with things like DreamBooth to start producing porn of celebrities… or, even more worrying, people you know. Seriously folks, we are within a year or less of this being trivial. It’s already possible with a lot of work today.
- Gigachad 4y agoI have no idea how it works but I have seen people talking about models trained to draw furry art. And I assume no one spent the millions on AWS to train a full model from scratch.
- jeroenhd 4y agoI believe what they do is take the released version of stable diffusion and then continue training from there with their own image sets. I came across their attempts when looking into how to train the model based on some images of my own; their data set so far reaches between tens of thousands and hundreds of thousands images. All the difficult parts (poses, backgrounds, art styles) has already been done by the SD researchers, the porn network only needs reference material for the NSFW description/tags/details. This is significantly cheaper. A similar project, training SD to output images in the style of Arcane, is incredibly successful in replicating the animation style with what seems to be very little actual training data. I don't think you need to start from scratch at all if you use the SD model as a base, all you need to do is to train it on specific concepts, styles and key words that the original doesn't have.
- version_five 4y agoNo. The whole point of these models is that they combine information across domains to be able to create new images. If you trained something just on, say baseball, you could only generate the normal things that happen in baseball. If you wanted to generate a picture of a bear surfing around the bases after hitting a home run, you'd need a model that also had bears and surfing in the training data, and enough other stuff to understand the relationships involved in positioning everything and changing poses.
- vintermann 4y agoEven if porn is what you want, it's not clear that's what you want. It can probably generate better porn if it has a little context about what, say, a bedroom is. What's more interesting, is that there's evidence (from public posts, I haven't tried these models myself) that models trained on some porn get better at non-porn images too.
- minimaxir 4y agoIn practice, it's unclear how well avoiding training on NSFW images will work: the original LAION-400M dataset used for both SD versions did filter out some of the NSFW stuff, and it appears SD 2.0 filters out a bit more. The use of OpenCLIP in SD 2.0 may also prevent some leakage of NSFW textual concepts compared to OpenAI's CLIP. It will, however, definitely not affect the more-common use case of anime women with very large breasts. And people will be able to finetune SD 2.0 on NSFW images anyways.
- kmeisthax 4y agoThe main reason why Stable Diffusion is worried about NSFW is that people will use it to generate disgusting amounts of CSAM. If LAION-5B or OpenAI's CLIP have ever seen CSAM - and given how these datasets are literally just scraped off the Internet, they have - then they're technically distributing it. Imagine the "AI is just copying bits of other people's art" argument, except instead of statutory damages of up to $150,000 per infringement, we're talking about time in pound-me-in-the-ass prison. At least if people have to finetune the model on that shit, then you can argue that it's not your fault because someone had to do extra steps to put stuff in there.
- fastball 4y agoIs artificially generated CSAM that doesn't actually involve children in its production not an improvement over the status quo?
- kyletns 4y agolol there's a piping hot take
- PartiallyTyped 4y agoReminds me of flooding a market with fake rhino horn. Idk whether it worked though.
- TaylorAlexander 4y agoI have no answer to this but I have seen people mention that artificial CSAM is illegal in the USA, so the question of whether it is better or not is somewhat overshadowed by the very large market where it is illegal.
- satvikpendem 4y agoThey reportedly did so to stop people from generating CSAM [0]. [0] https://old.reddit.com/r/StableDiffusion/comments/y9ga5s/stability_ais_take_on_stable_diffusion_15_and_the/it5kkic/?context=99 https://old.reddit.com/r/StableDiffusion/comments/y9ga5s/sta...
- Gigachad 4y agoNow that's a can of worms I don't think anyone wants to open.
- mysterydip 4y agoSome do, that's the problem.
- randyrand 4y agoArtist have been drawing people of all ages having sex for literally thousands of years. Why should I care about that?
- throwup 4y agoDo pixels have human rights now?
- syockit 4y agoThey don't. The training dataset though, may have been obtained through human rights violation. The problem is when the novelty starts to wear out. Then they will start to look for fresh training data which may again incur more human rights violation. If you can ensure that no new training data are obtained that way, then I guess it's okay? (Personally, I don't condone it)
- Zuiii 4y ago> The problem is when the novelty starts to wear out. Isn't the main feature of stable diffusion is that it doesn't?
- cma 4y ago(Edit: it may have removed that wording now: https://github.com/Stability-AI/stablediffusion/commit/ca86da3a30c4e080d4db8c25fca73de843663cb4 https://github.com/Stability-AI/stablediffusion/commit/ca86d... ) They can force model upgrades too: > The New AI Model Licenses Have a Legal Loophole (OpenRAIL-M of Stable Diffusion) https://www.youtube.com/watch?v=W5M-dvzpzSQ https://www.youtube.com/watch?v=W5M-dvzpzSQ
- emadm 4y agoActually the license is not the same as the prior one to remove this
- josephcsible 4y agoI don't understand why so many people call Stable Diffusion open source.
- myaccount9786 4y agoYou can download the model weights and run them offline. At least, you could in v1.4. I assume this is still possible on v2.0?
- schoen 4y agoRight, but the model weights are arguably not the "source code", and the license gives the users fewer rights than open source licenses do. https://en.wikipedia.org/wiki/The_Open_Source_Definition https://en.wikipedia.org/wiki/The_Open_Source_Definition
- myaccount9786 4y agoI think the controls in this space are such a shit show right now that being "open model" is practically equivalent to a WTFPL. If you're trying to build an app based on SD, then not being open source matters. But seems like the majority of use cases are just "I want to run the model locally". And at that point HF can't stop me from just ripping the Wi-Fi card out of my computer.
- kristopolous 4y agoDid they exclude celebrities, politicians, and religious and political symbols? Deceitful extremists and vengeful criminals fabricating lies seem to be a far more serious problem than fantasy porno.
- pkdpic 4y agoThat's a really interesting point, and it makes me realize that the Nancy Reagan 'what constitutes porn' question is obviously super old and problematic. Also lexica.art is swarming with celebrity fantasy porn that just has a thin stylistic filter of paintings from the 19th century. And a plethora of furry daddies that you can't not love. I get why these models should be curated but I also like that the sketchy porn possibilities keep them feeling un-padded / interesting / dangerous. Then again this all is probably really dangerous so maybe that's silly.
- rootusrootus 4y ago> Nancy Reagan 'what constitutes porn' question I thought that was Justice Stewart? And then he answered it "I know it when I see it."
- bloaf 4y agoThey know they are going to be the next target in the war on general purpose computing. They're trying to stave it off for as long as possible by signalling to the authorities that they are the good guys. A confrontation is inevitable, though. Right now it costs moderate sums of money to do this level of training. Not always will this be so. If I were an AI-centric organization, I would be racing to position myself as a trustworthy actor in my particular corner of the AI space so that when legislators start asking questions about the explosion of bad actors, I can engage in a little bit of regulatory capture, and have the legislators legislate whatever regulations I've already implemented, to the disadvantage of my competitors. For people who say "people can make whatever images they like in photoshop," I will remind you of this: https://i.imgur.com/5DJrd.jpg https://i.imgur.com/5DJrd.jpg
- hackernewds 4y agoVery niche example here, that can be easily circumvented Also seems problematic to approach this from a purely capitalistic and consumerist angle. There is a lot of opportunity here besides just launching the next AI unicorn.
- dougmwne 4y agoI am not clicking that link because no one should take the risk of you proving your point of what horrors could pop out of one of these models. I will say that while the government backlash is inevitable just like it was with encryption, these image generation models are so easy to train on consumer hardware that the cat is hopelessly out of the bag. It might as well be thoughtcrime.
- llui85 4y agoLink doesn't show any model output - it's an screenshot of photoshop refusing to edit a banknote.
- bongobingo1 4y agoOr it's an output of "blank adobe photoshop with dialog refusing to edit bank note, full screen, windows vista, 4k, artstation, greg rutkowski, dramatic lighting".
- myaccount9786 4y agoThe easiest way to combat this is to put your model behind an API and filter queries (midjourney, OpenAI) or just not make it available (Google). The tradeoff is that you're paying for everyone's compute. I guess SD is betting on saving $ on compute being more important in this space than the ability to gatekeep certain queries. And the tradeoff is that you need to do nsfw filtering in your released model. It will be interesting to see who's right in 2 years.
- techsin101 4y agothat would suck immensely for various downsides
- wongarsu 4y agoMaking a bulletproof filter is incredibly difficult, even more so in a topic where image descriptions are written in a culture that often has to circumvent text filters. Both midjourney's and OpenAI's filter works mostly because of the threat of bans if you try to circumvent them. I'm not sure I would describe that as "the easy solution"