4 ms·

I've started looking at profiles of the non-technical "AI at any cost" people on Reddit and noticed a trend towards AI generated NSFW posts and anime. Unsurpris

I've started looking at profiles of the non-technical "AI at any cost" people on Reddit and noticed a trend towards AI generated NSFW posts and anime. Unsurprisingly they tend to have zero tolerance towards accepting legitimate criticisms or concerns. After reading about the blackmail a school system in the UK faced because criminals took a public post of 10 year old soccer players and generated sexual child abuse materials with the real girls faces it's in everyones best interests to not post their children's images until or unless we can regulate this behavior. https://www.malwarebytes.com/blog/family-and-parenting/2026/05/deepfake-sextortion-forces-schools-to-remove-student-photos-from-websites https://www.malwarebytes.com/blog/family-and-parenting/2026/... "By November 2025, IWF reports of AI-generated CSAM had more than doubled year over year, rising from 199 to 426. Girls accounted for 94% of the victims. Reported cases included children ranging from newborns to two-year-olds, according to the organization. The ecosystem around these tools is industrial. In April 2025, a researcher found an exposed AWS S3 bucket belonging to South Korean “nudify” app GenNomis containing 93,485 AI-generated images alongside the prompts that produced them."

0cf8612b2e1e 4mo ago
What more regulation needs to happen? Real or synthetic CSAM is already illegal. Adding another law that is effectively, “Same thing as the previous ones, but this time the generator is a LLM, not Photoshop”.
- thatguy0900 4mo ago
  They want the regulation to be that Ai models cannot produce such images at all, not that producing them is illegal
  - zamalek 4mo ago
    You'd have to have a model that has never seen children, which is perfectly fine, but I can't see any of those with the resources to train such a model form scratch actually doing so.
    - _aavaa_ 4mo ago
      Wouldn’t help. You just ask for a short adult with slightly different proportions.
      - cyanydeez 4mo ago
        Guys, it's always the victims fault. Grift Economy 101. No way to prevent this says Grift Economists for the 928401st time. Better write another check to big business.
        Yiin 4mo ago
        they're not wrong though

0cf8612b2e1e 4mo ago

What more regulation needs to happen? Real or synthetic CSAM is already illegal. Adding another law that is effectively, “Same thing as the previous ones, but this time the generator is a LLM, not Photoshop”.

thatguy0900 4mo ago
They want the regulation to be that Ai models cannot produce such images at all, not that producing them is illegal
- zamalek 4mo ago
  You'd have to have a model that has never seen children, which is perfectly fine, but I can't see any of those with the resources to train such a model form scratch actually doing so.
  - _aavaa_ 4mo ago
    Wouldn’t help. You just ask for a short adult with slightly different proportions.
    - cyanydeez 4mo ago
      Guys, it's always the victims fault. Grift Economy 101. No way to prevent this says Grift Economists for the 928401st time. Better write another check to big business.
      - Yiin 4mo ago
        they're not wrong though