5 ms·

That'll only work for a little while longer (for future named big-public-release models, obviously the cat's out of the bag for the current version of stable di

That'll only work for a little while longer (for future named big-public-release models, obviously the cat's out of the bag for the current version of stable diffusion), right up until the point where they incorporate the filter into the training process. At which point, the end model users get to download will be incapable of producing anything that comes close to triggering the filter, and there will be no way to work around it short of training/fine-tuning your own model, which is prohibitively expensive for 'normal' people, even people with top-of-the-line graphics cards like a 4090.

pifm_guy 4y ago
Fine-tuning is pretty cheap compared to the original training run - perhaps just 1% of the cost. Totally within reach of a consortium of.... "entertainment specialists".
- netruk44 4y ago
  I know a person who fine-tuned stable diffusion, and he said it took 2 weeks of 8xA100 80 GB training time, costing him somewhere between $500-$700 (he got a pretty big discount, too, at today's prices for peer GPU rental it would be over $1,000). Sure, it's peanuts compared to what it must have cost to train stable diffusion from scratch. However, I think most normal people would not consider spending $500 to fine-tune one of these. Edit: Though I do agree that once this kind of filtering is in place during training, NSFW models will begin to pop up all over the place.
  - minimaxir 4y ago
    For spot-finetuning with Dreambooth (not as good as full-finetuning but can get a specific subject/style much faster), it can be done with about $0.08 of GPU compute, although optimizing it is harder. https://huggingface.co/docs/diffusers/training/dreambooth https://huggingface.co/docs/diffusers/training/dreambooth
    - netruk44 4y ago
      Are these services using textual-inversion? If so, I have to wonder how well they would work on a stable diffusion model that was trained with the filter in place from the start, so that it couldn't generate anything close to the filter. As it is right now, stable diffusion can generate adult imagery by itself, however it seems like it's been fine-tuned after the fact to try to 'cover up' that fact as much as they could before releasing the model publicly.
      - gpderetta 4y ago
        As far as I understand textual inversion != Dreambooth != Actual fine-tuning
      - seaal 4y ago
        I believe the safety filter is trivial to disable since it was added in one of the last commits prior to Stable Diffusion’s public release and not baked into the model, therefore most forks just remove the safety checker code [1] As far as textual inversion, JoePenna’s Dreambooth [2] implementation uses Textual Inversion. [1] https://github.com/CompVis/stable-diffusion/commit/a6e2f3b120eba81e9c290144f46ceda2145f1248 https://github.com/CompVis/stable-diffusion/commit/a6e2f3b12... [2] https://github.com/JoePenna/Dreambooth-Stable-Diffusion https://github.com/JoePenna/Dreambooth-Stable-Diffusion
  - cookingrobot 4y ago
    You can fine tune stable diffusion for $10 using this service: https://www.strmr.com/ https://www.strmr.com/ It works super well for putting yourself in the images, the likeness is fantastic. It’s obviously a small training process, they only take 20 images, but it works.
Animats 4y ago
That problem is being solved. Pornhub now has an AI R&D unit.[1] Their current project is to upscale and colorize out of copyright vintage porn. As a training set, they use modern porn. They point out that they have access to a big training set. Next step, porn generation. [1] https://www.pornhub.com/art/remastured https://www.pornhub.com/art/remastured
- sillysaurusx 4y ago
  For a glimpse at what’s possible: https://www.reddit.com/r/unstablediffusion https://www.reddit.com/r/unstablediffusion https://www.reddit.com/r/aiwaifu https://www.reddit.com/r/aiwaifu I’ve been trying to generate tentacle porn since 2019 or so. It’s the whole reason I got into AI. We’re finally there, and it only took three years. Can’t wait to see what 2026 brings. http://n.actionsack.com/pic/media%2FFh08F_hXkAAhalt.jpg http://n.actionsack.com/pic/media%2FFh08F_hXkAAhalt.jpg
  - GuB-42 4y ago
    > https://www.reddit.com/r/unstablediffusion https://www.reddit.com/r/unstablediffusion This subreddit was banned due to a violation of Reddit's rules against non-consensual intimate media. Interesting. Why "non-consensual"? Does it mean Stable Diffusion generated porn of people who actually exist?
    - sbierwagen 4y ago
      Yes, reddit routinely bans deepfake subreddits. In practice, this means any net that can produce output that looks like any living person is banned.
    - emmelaich 4y ago
      unstable_diffusion is still around. Note the underscore.
    - sillysaurusx 4y ago
      Sorry all, I was typing it on my phone and missed an underscore. Here’s the proper link: https://www.reddit.com/r/unstable_diffusion https://www.reddit.com/r/unstable_diffusion
TaylorAlexander 4y ago
This prediction doesn’t track with what is already happening. Dreambooth is allowing all kinds of people to fine tune their own models at home with nvidia graphics cards, and people are sharing all kinds of updated models that do really well at specific art styles or with NSFW subjects. Go check the nsfw subreddit unstable_diffusion for examples. It seems lots of people are training nsfw models with their own preferred data sets and last I saw someone merged all those checkpoints together in to one model. So if I made a prediction it would be that the training sets for open models from big companies will get scrubbed of nsfw content and then nerds on Reddit will just release their own versions with it added in, and the big companies will make sure everyone knows they didn’t add that stuff and that’s where it will stand.
- netruk44 4y ago
  I agree with your prediction. Sorry, I was unclear in my post, and left that part unsaid. I agree that it will likely just be the big newly released 'base' models that will be scrubbed of NSFW images, but there's really no way to prevent these models from making those kinds of images at all. It will only take some dedicated individuals, which I know there is no shortage of.
- langitbiru 4y ago
  The AI-generated art with Dreambooth works only for avatar type pics. It cannot create fancy gestures (doing a complicated movement with hands, like patting a cat). For now.
ben_w 4y ago
Training's only prohibitively expensive for normal people today, and the dollar cost per compute operation is still decreasing fairly rapidly.
xtagon 4y ago
This (training a model with no NSFW content) would be preferable to me. No false positives to worry about. People who do want to generate NSFW stuff can fine-tune or train their own model, nobody owes that functionality to them in freely available ones.

pifm_guy 4y ago

Fine-tuning is pretty cheap compared to the original training run - perhaps just 1% of the cost. Totally within reach of a consortium of.... "entertainment specialists".

netruk44 4y ago
I know a person who fine-tuned stable diffusion, and he said it took 2 weeks of 8xA100 80 GB training time, costing him somewhere between $500-$700 (he got a pretty big discount, too, at today's prices for peer GPU rental it would be over $1,000). Sure, it's peanuts compared to what it must have cost to train stable diffusion from scratch. However, I think most normal people would not consider spending $500 to fine-tune one of these. Edit: Though I do agree that once this kind of filtering is in place during training, NSFW models will begin to pop up all over the place.
- minimaxir 4y ago
  For spot-finetuning with Dreambooth (not as good as full-finetuning but can get a specific subject/style much faster), it can be done with about $0.08 of GPU compute, although optimizing it is harder. https://huggingface.co/docs/diffusers/training/dreambooth https://huggingface.co/docs/diffusers/training/dreambooth
  - netruk44 4y ago
    Are these services using textual-inversion? If so, I have to wonder how well they would work on a stable diffusion model that was trained with the filter in place from the start, so that it couldn't generate anything close to the filter. As it is right now, stable diffusion can generate adult imagery by itself, however it seems like it's been fine-tuned after the fact to try to 'cover up' that fact as much as they could before releasing the model publicly.
    - gpderetta 4y ago
      As far as I understand textual inversion != Dreambooth != Actual fine-tuning
    - seaal 4y ago
      I believe the safety filter is trivial to disable since it was added in one of the last commits prior to Stable Diffusion’s public release and not baked into the model, therefore most forks just remove the safety checker code [1] As far as textual inversion, JoePenna’s Dreambooth [2] implementation uses Textual Inversion. [1] https://github.com/CompVis/stable-diffusion/commit/a6e2f3b120eba81e9c290144f46ceda2145f1248 https://github.com/CompVis/stable-diffusion/commit/a6e2f3b12... [2] https://github.com/JoePenna/Dreambooth-Stable-Diffusion https://github.com/JoePenna/Dreambooth-Stable-Diffusion
- cookingrobot 4y ago
  You can fine tune stable diffusion for $10 using this service: https://www.strmr.com/ https://www.strmr.com/ It works super well for putting yourself in the images, the likeness is fantastic. It’s obviously a small training process, they only take 20 images, but it works.

Animats 4y ago

That problem is being solved. Pornhub now has an AI R&D unit.[1] Their current project is to upscale and colorize out of copyright vintage porn. As a training set, they use modern porn. They point out that they have access to a big training set. Next step, porn generation. [1] https://www.pornhub.com/art/remastured https://www.pornhub.com/art/remastured

sillysaurusx 4y ago
For a glimpse at what’s possible: https://www.reddit.com/r/unstablediffusion https://www.reddit.com/r/unstablediffusion https://www.reddit.com/r/aiwaifu https://www.reddit.com/r/aiwaifu I’ve been trying to generate tentacle porn since 2019 or so. It’s the whole reason I got into AI. We’re finally there, and it only took three years. Can’t wait to see what 2026 brings. http://n.actionsack.com/pic/media%2FFh08F_hXkAAhalt.jpg http://n.actionsack.com/pic/media%2FFh08F_hXkAAhalt.jpg
- GuB-42 4y ago
  > https://www.reddit.com/r/unstablediffusion https://www.reddit.com/r/unstablediffusion This subreddit was banned due to a violation of Reddit's rules against non-consensual intimate media. Interesting. Why "non-consensual"? Does it mean Stable Diffusion generated porn of people who actually exist?
  - sbierwagen 4y ago
    Yes, reddit routinely bans deepfake subreddits. In practice, this means any net that can produce output that looks like any living person is banned.
  - emmelaich 4y ago
    unstable_diffusion is still around. Note the underscore.
  - sillysaurusx 4y ago
    Sorry all, I was typing it on my phone and missed an underscore. Here’s the proper link: https://www.reddit.com/r/unstable_diffusion https://www.reddit.com/r/unstable_diffusion

TaylorAlexander 4y ago

This prediction doesn’t track with what is already happening. Dreambooth is allowing all kinds of people to fine tune their own models at home with nvidia graphics cards, and people are sharing all kinds of updated models that do really well at specific art styles or with NSFW subjects. Go check the nsfw subreddit unstable_diffusion for examples. It seems lots of people are training nsfw models with their own preferred data sets and last I saw someone merged all those checkpoints together in to one model. So if I made a prediction it would be that the training sets for open models from big companies will get scrubbed of nsfw content and then nerds on Reddit will just release their own versions with it added in, and the big companies will make sure everyone knows they didn’t add that stuff and that’s where it will stand.

netruk44 4y ago
I agree with your prediction. Sorry, I was unclear in my post, and left that part unsaid. I agree that it will likely just be the big newly released 'base' models that will be scrubbed of NSFW images, but there's really no way to prevent these models from making those kinds of images at all. It will only take some dedicated individuals, which I know there is no shortage of.
langitbiru 4y ago
The AI-generated art with Dreambooth works only for avatar type pics. It cannot create fancy gestures (doing a complicated movement with hands, like patting a cat). For now.

ben_w 4y ago

Training's only prohibitively expensive for normal people today, and the dollar cost per compute operation is still decreasing fairly rapidly.

xtagon 4y ago

This (training a model with no NSFW content) would be preferable to me. No false positives to worry about. People who do want to generate NSFW stuff can fine-tune or train their own model, nobody owes that functionality to them in freely available ones.