15 ms·

Same for me. Got an NSFW warning for "A ten year old boy daydreaming"

by eruci 4y ago

leobg 4y ago
If what the model wanted to generate based on that prompt is considered not safe for work, you know what the training data must’ve been like...
- phonescreen_man 4y ago
  That’s a dark thought right there.
- capableweb 4y ago
  The prompt "A ten year old boy daydreaming" is a bit haunted, as it's not specific enough to generate good results. But the results from running that does not result in NSFW content, contrary to what you say. Most of these NSFW "blockers" simply act on keywords like "ten year old boy" rather than trying to understand the output. Here is 9 images of the prompt "A ten year old boy daydreaming" with various settings. None of them are good (bad prompt + no tuning on my side), but none of them are NSFW either: https://imgur.com/a/FcBv05w https://imgur.com/a/FcBv05w (slightly off-topic, seems there is a lot of misinformation in this thread, from misunderstanding the training data, to how the NSFW content block some platforms are implementing works)
  - ShamelessC 4y ago
    It is a vision based nsfw classifier, not keyword based.
  - leobg 4y ago
    I was just being snarky. I didn’t actually think the content filter would take into account what the model would actually output. I thought it probably was just a really bad keyword based filter. Thanks for sharing these examples. Good to see what the model actually produces with that prompt.
- ShamelessC 4y ago
  More likely, the NSFW classifier has a lot of false positives because that’s the only way to effectively prevent those outputs, even though it causes it to detect nsfw when there is none.
  - leobg 4y ago
    Well, it is true that a 10 year old can be quite distracting at work. However, so is playing with stable diffusion models in general. (Which is probably why we are getting that message on basically every prompt.) ;)
    - ShamelessC 4y ago
      What?
m00dy 4y ago
same for me. "a river between mountains"
- keerthiko 4y ago
  well that one makes more sense than some of these others...

Same for me. Got an NSFW warning for "A ten year old boy daydreaming"

by eruci 4y ago

Same for me. Got an NSFW warning for "A ten year old boy daydreaming"

If what the model wanted to generate based on that prompt is considered not safe for work, you know what the training data must’ve been like...

phonescreen_man 4y ago
That’s a dark thought right there.
capableweb 4y ago
The prompt "A ten year old boy daydreaming" is a bit haunted, as it's not specific enough to generate good results. But the results from running that does not result in NSFW content, contrary to what you say. Most of these NSFW "blockers" simply act on keywords like "ten year old boy" rather than trying to understand the output. Here is 9 images of the prompt "A ten year old boy daydreaming" with various settings. None of them are good (bad prompt + no tuning on my side), but none of them are NSFW either: https://imgur.com/a/FcBv05w https://imgur.com/a/FcBv05w (slightly off-topic, seems there is a lot of misinformation in this thread, from misunderstanding the training data, to how the NSFW content block some platforms are implementing works)
- ShamelessC 4y ago
  It is a vision based nsfw classifier, not keyword based.
- leobg 4y ago
  I was just being snarky. I didn’t actually think the content filter would take into account what the model would actually output. I thought it probably was just a really bad keyword based filter. Thanks for sharing these examples. Good to see what the model actually produces with that prompt.
ShamelessC 4y ago
More likely, the NSFW classifier has a lot of false positives because that’s the only way to effectively prevent those outputs, even though it causes it to detect nsfw when there is none.
- leobg 4y ago
  Well, it is true that a 10 year old can be quite distracting at work. However, so is playing with stable diffusion models in general. (Which is probably why we are getting that message on basically every prompt.) ;)
  - ShamelessC 4y ago
    What?

m00dy 4y ago

same for me. "a river between mountains"

keerthiko 4y ago
well that one makes more sense than some of these others...