6 ms·

Reddit bans users posting NSFW cyber-porn made with AI image generator

24 points by monort 4y ago

IceMetalPunk 4y ago
Having seen quite a few of these Stable Diffusion porn generations, can I just say they're less porn and more nightmare fuel? Those faces... and hands... shudder It does relatively better at generating faces in portraits, but the more zoomed out you get, the worse the faces become. And that's just in general, not specifically nudes. That said, as long as (a) these subreddits moderate the content to remove generations depicting real people, and (b) the subreddits are marked as NSFW with the usual "I am 18+" acknowledgement to enter, I don't see why the subreddits need to be shut down entirely.
- Asraelite 4y ago
  > as long as (a) these subreddits moderate the content to remove generations depicting real people, and (b) the subreddits are marked as NSFW with the usual "I am 18+" acknowledgement to enter, I don't see why the subreddits need to be shut down entirely. Reddit has long stopped caring about being reasonable when it comes to subreddit bans. Their policy now is to just stay well on the safe side with things like this.
- RationPhantoms 4y ago
  Why is everyone with criticisms about DALLE-E, Midjourney and Stable Diffusion so focused on their day 1 capabilities? The fact that it can do any of what it does today, is absolutely insane. Is no one focusing on what day 36 or year 2 will look like? I've been privy to some of the model iterations Midjourney has gone through on their Discord and in a series of a few weeks, they've made substantial gains on generating faces from their V1, V2 and V3 models. Within a short amount of time, this will no longer be a complaint. In relation to OP's post, I guess Reddit can't guarantee this won't also turn into DeepFake territory so they're banning it outright.
  - IceMetalPunk 4y ago
    Oh, don't get me wrong, I agree! Since the invention of transformers, progress in generative AI models has accelerated exponentially. It's an exciting time to live, and they are definitely extraordinary! (I mention transformers because basically every bleeding-edge AI in the last few years has integrated a transformer somewhere in its architecture. They really spurred an AI revolution.) That said... it would be lying to claim Stable Diffusion's current generations aren't nightmare fuel :D
    - throwaway5959 4y ago
      Maybe lead with that then.
      - naniwaduni 4y ago
        Why would someone want to lead with irrelevant sermons to the choir before making the remark they came to make?
  - tracerbulletx 4y ago
    This, plus the day one capabilities are already useful and are actively being used. For each weird bizarre output there's also one you can barely tell wasn't made by a relatively talented human artist.
- dzhiurgis 4y ago
  There’s plenty of nightmare porn on reddit. Let’s not kink shame.
Viliam1234 4y ago
> Users attempting to access the site are greeted with the message: ‘This subreddit was banned due to a violation of Reddit’s rules against non-consensual intimate media.’ It's perfectly logical. If a person does not exist... then they can't consent to having sexy pictures of them published!
- eimrine 4y ago
  It exist, just someone's pussy is exposed out of contest. Kind of when bad student steals parts of someone's thesis without proper citation.
  - eimrine 4y ago
    Several guys who have downvoted me believe that NN can draw pussies out of nothing?
    - Viliam1234 4y ago
      I assume the pussies -- just like everything else -- are generated as some machine-learning combination of pussies present in the training set. So the analogy would be accusing a student of plagiarism for using the same words (or maybe same letters) as other people (not anyone specific, but the university library as a whole).
bjourne 4y ago
How can ML models generate porn if they weren't trained on porn? It can't generate what it hasn't seen, right? So why are they training their models on porn?
- eimrine 4y ago
  rule 34?
  - salawat 4y ago
    No. Exceptions.
- thebruce87m 4y ago
  Perhaps to provide negative samples so that it doesn’t generate porn-like imagery the rest of the time?
boomboomsubban 4y ago
This whole "consent" part seems to be a clever way of saying a license violation occurred. I wonder if they'll allow such subreddits when home creation is possible.
warning26 4y ago
Seems like a ridiculous decision which could be solved by banning particular classes of generations (presumably Deepfake type material is what they're concerned about). However, Reddit isn't exactly good at making product decisions anymore (see: New Reddit), so I suppose their lack of sense isn't exactly shocking.
stuntkite 4y ago
Wow. It is really really hard to find the actual images people are producing. Fuck, I do not need another chore like doing that myself this weekend.

24 points by monort 4y ago

Having seen quite a few of these Stable Diffusion porn generations, can I just say they're less porn and more nightmare fuel? Those faces... and hands... shudder It does relatively better at generating faces in portraits, but the more zoomed out you get, the worse the faces become. And that's just in general, not specifically nudes. That said, as long as (a) these subreddits moderate the content to remove generations depicting real people, and (b) the subreddits are marked as NSFW with the usual "I am 18+" acknowledgement to enter, I don't see why the subreddits need to be shut down entirely.

Asraelite 4y ago
> as long as (a) these subreddits moderate the content to remove generations depicting real people, and (b) the subreddits are marked as NSFW with the usual "I am 18+" acknowledgement to enter, I don't see why the subreddits need to be shut down entirely. Reddit has long stopped caring about being reasonable when it comes to subreddit bans. Their policy now is to just stay well on the safe side with things like this.
RationPhantoms 4y ago
Why is everyone with criticisms about DALLE-E, Midjourney and Stable Diffusion so focused on their day 1 capabilities? The fact that it can do any of what it does today, is absolutely insane. Is no one focusing on what day 36 or year 2 will look like? I've been privy to some of the model iterations Midjourney has gone through on their Discord and in a series of a few weeks, they've made substantial gains on generating faces from their V1, V2 and V3 models. Within a short amount of time, this will no longer be a complaint. In relation to OP's post, I guess Reddit can't guarantee this won't also turn into DeepFake territory so they're banning it outright.
- IceMetalPunk 4y ago
  Oh, don't get me wrong, I agree! Since the invention of transformers, progress in generative AI models has accelerated exponentially. It's an exciting time to live, and they are definitely extraordinary! (I mention transformers because basically every bleeding-edge AI in the last few years has integrated a transformer somewhere in its architecture. They really spurred an AI revolution.) That said... it would be lying to claim Stable Diffusion's current generations aren't nightmare fuel :D
  - throwaway5959 4y ago
    Maybe lead with that then.
    - naniwaduni 4y ago
      Why would someone want to lead with irrelevant sermons to the choir before making the remark they came to make?
- tracerbulletx 4y ago
  This, plus the day one capabilities are already useful and are actively being used. For each weird bizarre output there's also one you can barely tell wasn't made by a relatively talented human artist.
dzhiurgis 4y ago
There’s plenty of nightmare porn on reddit. Let’s not kink shame.

Viliam1234 4y ago

> Users attempting to access the site are greeted with the message: ‘This subreddit was banned due to a violation of Reddit’s rules against non-consensual intimate media.’ It's perfectly logical. If a person does not exist... then they can't consent to having sexy pictures of them published!

eimrine 4y ago
It exist, just someone's pussy is exposed out of contest. Kind of when bad student steals parts of someone's thesis without proper citation.
- eimrine 4y ago
  Several guys who have downvoted me believe that NN can draw pussies out of nothing?
  - Viliam1234 4y ago
    I assume the pussies -- just like everything else -- are generated as some machine-learning combination of pussies present in the training set. So the analogy would be accusing a student of plagiarism for using the same words (or maybe same letters) as other people (not anyone specific, but the university library as a whole).

bjourne 4y ago

How can ML models generate porn if they weren't trained on porn? It can't generate what it hasn't seen, right? So why are they training their models on porn?

eimrine 4y ago
rule 34?
- salawat 4y ago
  No. Exceptions.
thebruce87m 4y ago
Perhaps to provide negative samples so that it doesn’t generate porn-like imagery the rest of the time?

boomboomsubban 4y ago

This whole "consent" part seems to be a clever way of saying a license violation occurred. I wonder if they'll allow such subreddits when home creation is possible.

warning26 4y ago

Seems like a ridiculous decision which could be solved by banning particular classes of generations (presumably Deepfake type material is what they're concerned about). However, Reddit isn't exactly good at making product decisions anymore (see: New Reddit), so I suppose their lack of sense isn't exactly shocking.

stuntkite 4y ago

Wow. It is really really hard to find the actual images people are producing. Fuck, I do not need another chore like doing that myself this weekend.