5 ms·

> Grok AI generated large amounts of CSAM and nonconsensual intimate imagery Grok Imagine has been considerably locked down in terms of intimate imagery over t

> Grok AI generated large amounts of CSAM and nonconsensual intimate imagery Grok Imagine has been considerably locked down in terms of intimate imagery over the last few weeks. E.g. Harley Quinn used to be one of the easiest characters to manipulate, with or without any resemblance to Margot Robbie. No more. X still serves up explicit hardcore, and Imagine used to get at least in that neighborhood, but that has been squelched. For prurient purposes, nerfed. Not at all limited to CSAM or real people. The pressure they're getting from all over seems to explain it.

thinkcontext 3mo ago
But they did resist locking it down, recall Musk making fun of concerns? They clearly don't take governance seriously, its whatever Musk is gravitating to in his filter bubble.
- andrewinardeer 3mo ago
  [flagged]
  - mingus88 3mo ago
    https://www.npr.org/2026/01/16/nx-s1-5678965/elon-musks-x-to-block-ai-chatbot-grok-from-making-explicit-images-of-real-people https://www.npr.org/2026/01/16/nx-s1-5678965/elon-musks-x-to... - after weeks of mocking critics, X’s approach shifted only after investigations mounted https://thehill.com/policy/technology/5689660-xai-investigation-nonconsensual-images/ https://thehill.com/policy/technology/5689660-xai-investigat... - musk “not aware” of any naked underage images, pushing back on concerns https://www.humanrightsresearch.org/post/a-new-form-of-gendered-violence-elon-musk-s-grok https://www.humanrightsresearch.org/post/a-new-form-of-gende... - musk downplays concerns and blames users and hackers
    - nailer 3mo ago
      From your NPR article: > Previously, users could ask Grok to edit images and put people into revealing clothing like bikinis. It's because bikini photos aren't generally considered CSAM, or weren't until this year. NPR states "Musk mocks critics" but there is no evidence of him mocking CSAM concerns, and the second two documents don't mention Musk making fun of concerns at all. From your second article: > musk “not aware” of any naked underage images There aren't any naked underage images. They were bikini photos as linked to from your first article: https://www.reuters.com/legal/litigation/grok-says-safeguard-lapses-led-images-minors-minimal-clothing-x-2026-01-02/ https://www.reuters.com/legal/litigation/grok-says-safeguard...
      - mingus88 3mo ago
        You are being intentionally obtuse. Why on earth you would feel the need to play this game when we all know Musk’s character is baffling.
        nailer 3mo ago
        No, the opposite. I’m being acute. You are vaguely (I suspect deliberately vaguely) referring to “CSAM generation“, I’m pointing out the specific issue of generating images of children wearing bathing suits (children wearing bathing suits has historically not been considered CSAM) and giving references to prove it. “we all know musk’s character” is not an argument, in fact, it’s a textbook example of https://www.logicallyfallacious.com/logicalfallacies/Appeal-to-Common-Belief https://www.logicallyfallacious.com/logicalfallacies/Appeal-.... I could make the same comment about his enemies.
        mingus88 3mo ago
        Look. OP said he couldn’t remember something so I provided some links to jog his memory. There is no shortage of examples of musk being a shithead for anyone who cares. I am not going to litigate every detail in these articles because that’s not the point of this thread but for SOME REASON you feel obligated to jump to an oligarch’s defense and I am not going to waste any more time on you. I mean really, what can I say to someone who is drawing lines around content of children in bikinis as some kind of defense. So weird and gross.
  - deleted 3mo ago
    [deleted]
  - actionfromafar 3mo ago
    Pepperidge Farm remembers.
  - bsder 3mo ago
    It's not up to the peanut gallery to disprove easily falsifiable statements from easily found public evidence.
    - nailer 3mo ago
      Do you mean that Musk not making fun of concerns is easily falsifiable, or Musk making fun of concerns is easily falsifiable? Nobody in this thread has been able to provide evidence that Musk mocked CSAM concerns.
- CSMastermind 3mo ago
  Reddit did the same. Tumblr died when it banned porn. There seems to be a very perverse incentive for social media platforms to be as permissive as possible. Personally, I'd be in favor of banning all sexual content on X, but it really feels like a legislative solution applying to all social media platforms might be the best solution. And yes I realize the slippery slope that could put us on.
  - hgoel 3mo ago
    The issue wasn't specifically allowing NSFW content, it was allowing anyone to get grok to openly make NSFW deepfakes of anyone without even an attempt at policing things.
  - miki123211 3mo ago
    > legislative solution In what country?
sieabahlpark 3mo ago
[dead]
WatchDog 3mo ago
Whatever you think about X's image generation models, I don't see how it is related to the petition that the EFF is opposing. Is generation of non-consensual imagery really a privacy issue? If someone publishes a real naked photo of you, that was acquired without your consent, that would be a privacy issue. If someone generates a naked photo of you, even if it looks identical to a real photo, it's not your private data.
- righthand 3mo ago
  Is it private data if it was scraped from my social media profile marked private but leaked through a shared party? My expectation was that image would only be shared with those I wanted to see it (form of privacy).
  - WatchDog 3mo ago
    That's fair. Is there any indication as to if xAi trains on private profiles?
    - righthand 3mo ago
      Is there any indication it doesn’t. From what you know about LLM teams, products, and engineers, especially XAI, does the word “private” or “Disallow: <my-private-profile-path>” seem to stop them?
- dualvariable 3mo ago
  In an ideal world, generated non-consensual imagery should be illegal through invasion of privacy through misappropriation of name or likeness, but I think only a limited number of states have those laws.
  - neuroticnews25 3mo ago
    Should it apply also to drawings? Detailed descriptions? Strong mental visualisations?
  - 3mo ago
vlian2088 3mo ago
[flagged]
- appplication 3mo ago
  Politely, what on earth point are you trying to make? Whatever it is it really is not coming across well.
  - vlian2088 3mo ago
    [dead]
- jimbooonooo 3mo ago
  Yes and we should stop at elsewhere too. " it happened elsewhere n times" is a terrible excuse for inaction.
  - vlian2088 3mo ago
    your iPhone can be used to film non-imaginary CSAM and securely distribute it with Signal over the Internet. think of the children and throw it into a blender.
    - queenkjuul 3mo ago
      My phone won't be used for that for as long as it belongs to me. If someone else does that with their phone, they should go to jail. If Elon published that data, he should too
- Stefan-H 3mo ago
  "We only build and operate the orphan crushing machine, it's people that line up to turn the crank".
  - vlian2088 3mo ago
    your phone, your browser, and the Internet itself are orphan crushing machines too, then.
chrisjj 3mo ago
> Grok AI generated large amounts of CSAM A myth. CSAM is evidence of real-world abuse. Grok fakes are by definition not that.
nailer 3mo ago
The original issue was specifically to do with bikini photos - parents often upload pictures of children in bathing suits without this being considered CSAM content, so Grok (and all other AI models) weren't moderating this. Here's the original article from Reuters: https://www.reuters.com/legal/litigation/grok-says-safeguard-lapses-led-images-minors-minimal-clothing-x-2026-01-02/ https://www.reuters.com/legal/litigation/grok-says-safeguard...

thinkcontext 3mo ago

But they did resist locking it down, recall Musk making fun of concerns? They clearly don't take governance seriously, its whatever Musk is gravitating to in his filter bubble.

andrewinardeer 3mo ago
[flagged]
- mingus88 3mo ago
  https://www.npr.org/2026/01/16/nx-s1-5678965/elon-musks-x-to-block-ai-chatbot-grok-from-making-explicit-images-of-real-people https://www.npr.org/2026/01/16/nx-s1-5678965/elon-musks-x-to... - after weeks of mocking critics, X’s approach shifted only after investigations mounted https://thehill.com/policy/technology/5689660-xai-investigation-nonconsensual-images/ https://thehill.com/policy/technology/5689660-xai-investigat... - musk “not aware” of any naked underage images, pushing back on concerns https://www.humanrightsresearch.org/post/a-new-form-of-gendered-violence-elon-musk-s-grok https://www.humanrightsresearch.org/post/a-new-form-of-gende... - musk downplays concerns and blames users and hackers
  - nailer 3mo ago
    From your NPR article: > Previously, users could ask Grok to edit images and put people into revealing clothing like bikinis. It's because bikini photos aren't generally considered CSAM, or weren't until this year. NPR states "Musk mocks critics" but there is no evidence of him mocking CSAM concerns, and the second two documents don't mention Musk making fun of concerns at all. From your second article: > musk “not aware” of any naked underage images There aren't any naked underage images. They were bikini photos as linked to from your first article: https://www.reuters.com/legal/litigation/grok-says-safeguard-lapses-led-images-minors-minimal-clothing-x-2026-01-02/ https://www.reuters.com/legal/litigation/grok-says-safeguard...
    - mingus88 3mo ago
      You are being intentionally obtuse. Why on earth you would feel the need to play this game when we all know Musk’s character is baffling.
      - nailer 3mo ago
        No, the opposite. I’m being acute. You are vaguely (I suspect deliberately vaguely) referring to “CSAM generation“, I’m pointing out the specific issue of generating images of children wearing bathing suits (children wearing bathing suits has historically not been considered CSAM) and giving references to prove it. “we all know musk’s character” is not an argument, in fact, it’s a textbook example of https://www.logicallyfallacious.com/logicalfallacies/Appeal-to-Common-Belief https://www.logicallyfallacious.com/logicalfallacies/Appeal-.... I could make the same comment about his enemies.
        mingus88 3mo ago
        Look. OP said he couldn’t remember something so I provided some links to jog his memory. There is no shortage of examples of musk being a shithead for anyone who cares. I am not going to litigate every detail in these articles because that’s not the point of this thread but for SOME REASON you feel obligated to jump to an oligarch’s defense and I am not going to waste any more time on you. I mean really, what can I say to someone who is drawing lines around content of children in bikinis as some kind of defense. So weird and gross.
- deleted 3mo ago
  [deleted]
- actionfromafar 3mo ago
  Pepperidge Farm remembers.
- bsder 3mo ago
  It's not up to the peanut gallery to disprove easily falsifiable statements from easily found public evidence.
  - nailer 3mo ago
    Do you mean that Musk not making fun of concerns is easily falsifiable, or Musk making fun of concerns is easily falsifiable? Nobody in this thread has been able to provide evidence that Musk mocked CSAM concerns.
CSMastermind 3mo ago
Reddit did the same. Tumblr died when it banned porn. There seems to be a very perverse incentive for social media platforms to be as permissive as possible. Personally, I'd be in favor of banning all sexual content on X, but it really feels like a legislative solution applying to all social media platforms might be the best solution. And yes I realize the slippery slope that could put us on.
- hgoel 3mo ago
  The issue wasn't specifically allowing NSFW content, it was allowing anyone to get grok to openly make NSFW deepfakes of anyone without even an attempt at policing things.
- miki123211 3mo ago
  > legislative solution In what country?

sieabahlpark 3mo ago

[dead]

WatchDog 3mo ago

Whatever you think about X's image generation models, I don't see how it is related to the petition that the EFF is opposing. Is generation of non-consensual imagery really a privacy issue? If someone publishes a real naked photo of you, that was acquired without your consent, that would be a privacy issue. If someone generates a naked photo of you, even if it looks identical to a real photo, it's not your private data.

righthand 3mo ago
Is it private data if it was scraped from my social media profile marked private but leaked through a shared party? My expectation was that image would only be shared with those I wanted to see it (form of privacy).
- WatchDog 3mo ago
  That's fair. Is there any indication as to if xAi trains on private profiles?
  - righthand 3mo ago
    Is there any indication it doesn’t. From what you know about LLM teams, products, and engineers, especially XAI, does the word “private” or “Disallow: <my-private-profile-path>” seem to stop them?
dualvariable 3mo ago
In an ideal world, generated non-consensual imagery should be illegal through invasion of privacy through misappropriation of name or likeness, but I think only a limited number of states have those laws.
- neuroticnews25 3mo ago
  Should it apply also to drawings? Detailed descriptions? Strong mental visualisations?
- 3mo ago

vlian2088 3mo ago

[flagged]

appplication 3mo ago
Politely, what on earth point are you trying to make? Whatever it is it really is not coming across well.
- vlian2088 3mo ago
  [dead]
jimbooonooo 3mo ago
Yes and we should stop at elsewhere too. " it happened elsewhere n times" is a terrible excuse for inaction.
- vlian2088 3mo ago
  your iPhone can be used to film non-imaginary CSAM and securely distribute it with Signal over the Internet. think of the children and throw it into a blender.
  - queenkjuul 3mo ago
    My phone won't be used for that for as long as it belongs to me. If someone else does that with their phone, they should go to jail. If Elon published that data, he should too
Stefan-H 3mo ago
"We only build and operate the orphan crushing machine, it's people that line up to turn the crank".
- vlian2088 3mo ago
  your phone, your browser, and the Internet itself are orphan crushing machines too, then.

chrisjj 3mo ago

> Grok AI generated large amounts of CSAM A myth. CSAM is evidence of real-world abuse. Grok fakes are by definition not that.

nailer 3mo ago

The original issue was specifically to do with bikini photos - parents often upload pictures of children in bathing suits without this being considered CSAM content, so Grok (and all other AI models) weren't moderating this. Here's the original article from Reuters: https://www.reuters.com/legal/litigation/grok-says-safeguard-lapses-led-images-minors-minimal-clothing-x-2026-01-02/ https://www.reuters.com/legal/litigation/grok-says-safeguard...