6 ms·
it's fun to try to find flaws in content blocking. interesting datapoints: it will block some sexually suggestive prompts regarding women (a woman swimming in
by 93po 4y ago
it's fun to try to find flaws in content blocking.
interesting datapoints: it will block some sexually suggestive prompts regarding women (a woman swimming in milk) but not for men (a man swimming in milk)
changing milk to "almond milk" got the prompt accepted but then blocked before showing image
refused any prompt with the word "bikini" (even for "on a statue") or "full body visible" (even if clothed)
I got suspended for the prompt "full bodied man" after "full bodied woman" was blocked.
Suspension says for violating content policy - I never asked a single time for anything explicitly sexual. Never asked for nudity, nakedness, sexuality, or anything like that. Never asked for a bikini or other revealing concept on a human. Only possible implications of sexual nature were "in milk" which it clearly found sexual, and "swimming" and only because it implies lots of skin showing.
In one instance, it showed a topless woman swimming, but breasts were blurred and had skin-colored nipples and basically looked like Barbie, and had shadows where nipples would go.
I am guessing it checks content two ways: both in the prompt, and then a second time on the actual generated image before displaying it. Which is smart.
I am guessing my suspension was based on blocked images, regardless of what I was asking for.
It's interesting that it also seemingly censors anything it detects as looking like nudity, but also in one case still displayed the censored version. or maybe it just happened to generate something that looked censored and therefore didn't trigger the nudity check
- dgant 4y agoDid the suspension carry a duration?
- 93po 4y agoIt didn't specify one. It gave me the option to contest it, I did, and it restored access a few hours later.
- ElijahLynn 4y agoIt blocked "a woman wearing a flower dress massaging a pregnant woman in a room with a view of the ocean and the sunset" that I was trying to generate for a client who offers pre-natal massage, I removed "pregnant" and it worked.
- 93po 4y agoIt seemingly blocks literally any sort of generation that shows skin. Several prompts around people on beaches only shows people who are 100% clothed. Images around swimming shows the person's body nearly entirely obscured by water and swimsuit. Massage implies showing skin too, so I imagine it would either use angles that don't show it or otherwise just block it as you saw. I assume the pregnant part caused blocking because it's difficult to show pregnancy in the context of a massage without showing skin.
- ElijahLynn 4y agoGuess it pays to err on the side of caution for now!