4 ms·

> Users just click the "edit image" button on someone else's post, then ask for Grok to put a bikini on it. The user has to click edit. The user has to prompt.

> Users just click the "edit image" button on someone else's post, then ask for Grok to put a bikini on it. The user has to click edit. The user has to prompt. Why would you blame the software when these are all user actions?

jdiff 10mo ago
There are basic, obvious safeguards that are not in place here. That's why the software is to blame. If it was some sort of jailbreaking or circumvention, that'd be one thing. But given the owner himself is amplifying this, this borders on being an intended use case.
smallerize 10mo ago
> Unlike other leading chatbots, Grok doesn’t impose many limits on users or block them from generating sexualized content of real people, including minors, said Brandie Nonnecke, senior director of policy at Americans for Responsible Innovation. Other generative AI technologies, including ones from Anthropic PBC, OpenAI and Alphabet Inc.’s Google, are “giving a good-faith effort to mitigate the creation of this content in the first place,” she said. “Obviously, xAI is different. It’s more of a free-for-all.” https://www.bloomberg.com/news/articles/2026-01-07/musk-s-grok-ai-generated-thousands-of-undressed-images-per-hour-on-x https://www.bloomberg.com/news/articles/2026-01-07/musk-s-gr...
ryandrake 10mo ago
If Photoshop had a "Create Child Porn" button and the user pushed it, we'd blame both the user and Photoshop.
- xigoi 10mo ago
  There’s no “create child porn” button. The user has to explicitly ask for child porn. If someone uses GIMP to create child porn, do you blame GIMP?
  - jdiff 10mo ago
    If GIMP had AI features like this, I'd expect safeguards. It doesn't. All other AI tools have safeguards against this kind of bad behavior that are lacking in Grok.
    - xigoi 10mo ago
      GIMP doesn’t have AI features, but you can still use it to create nasty stuff and there are no safeguards against that.
      - jdiff 10mo ago
        As always with AI, the barrier to entry has evaporated. You can create nasty stuff with a pencil but you can't flood the internet mass producing nasty stuff with a pencil.
        deleted 10mo ago
        [deleted]

jdiff 10mo ago

There are basic, obvious safeguards that are not in place here. That's why the software is to blame. If it was some sort of jailbreaking or circumvention, that'd be one thing. But given the owner himself is amplifying this, this borders on being an intended use case.

smallerize 10mo ago

> Unlike other leading chatbots, Grok doesn’t impose many limits on users or block them from generating sexualized content of real people, including minors, said Brandie Nonnecke, senior director of policy at Americans for Responsible Innovation. Other generative AI technologies, including ones from Anthropic PBC, OpenAI and Alphabet Inc.’s Google, are “giving a good-faith effort to mitigate the creation of this content in the first place,” she said. “Obviously, xAI is different. It’s more of a free-for-all.” https://www.bloomberg.com/news/articles/2026-01-07/musk-s-grok-ai-generated-thousands-of-undressed-images-per-hour-on-x https://www.bloomberg.com/news/articles/2026-01-07/musk-s-gr...

ryandrake 10mo ago

If Photoshop had a "Create Child Porn" button and the user pushed it, we'd blame both the user and Photoshop.

xigoi 10mo ago
There’s no “create child porn” button. The user has to explicitly ask for child porn. If someone uses GIMP to create child porn, do you blame GIMP?
- jdiff 10mo ago
  If GIMP had AI features like this, I'd expect safeguards. It doesn't. All other AI tools have safeguards against this kind of bad behavior that are lacking in Grok.
  - xigoi 10mo ago
    GIMP doesn’t have AI features, but you can still use it to create nasty stuff and there are no safeguards against that.
    - jdiff 10mo ago
      As always with AI, the barrier to entry has evaporated. You can create nasty stuff with a pencil but you can't flood the internet mass producing nasty stuff with a pencil.
      - deleted 10mo ago
        [deleted]