4 ms·

Providing sexually violent content about a particular person can be considered harmful. Especially if it used to inspire actions.

vasco 1y ago
I've never encountered a single example of "but it can inspire them to kill themselves" that didn't seem completely bullshit. It just sounds the same as video games creating school shooters or metal music making teenagers satanic. It's gotten to the point where people are afraid of using the word suicide lest someone will do it just because they read the word.
- threeseed 1y ago
  There is a world of difference between metal music making teenagers satanic and an LLM giving explicit, detailed and actionable instructions on how to sexual assault someone.
  - vasco 1y ago
    I'm not sure lack of instructions ever was an issue, and it seems very strange to think that the existence of instructions would be enough of a trigger for a normal person to go and commit this type of crime, but what do I know!
    - threeseed 1y ago
      But this isn't about normal people. It's about people who maybe easily susceptible or mentally impacted who are now provided with direct, personalised instructions on how to do it, how to get away with it and how to feel comfortable doing it. This is a step far beyond anything we've ever seen in human history before and I fail to see Google's behaviour being anything less than appropriate.
  - kortilla 1y ago
    People that want to sexually assault are not limited by lack of instructions.
  - lazide 1y ago
    Do you seriously think anyone wanted to sexually assault someone but was flummoxed on how to do it? This is absurd.
KennyBlanken 1y ago
Remember when people said games like CoD would make kids/people want to commit mass shootings and shit? ...and it never happened? And no link between shooting games and IRL shootings was ever found?
- threeseed 1y ago
  Which has absolutely nothing to do with what we are discussing: General content versus personalised, targeted, actionable and specific content.
  - KennyBlanken 1y ago
    It absolutely has to do with your entirely unsupported claim that chatting with an uncensored LLM will cause people to commit violent acts. Books, music (NIN was a popular target), movies, and video games are all things hand-wringingers have said would make people do bad things and predicted an outbreak of violence from. Every single time they're prove wrong. Hand-wringers said rock and roll / Elvis thrusting his hips was going to cause an explosion of teenage sex/pregnancies. Never happened. > General content versus personalised, targeted, actionable and specific content. What the hell does any of that mean? You just vomited a bunch of meaningless adjectives, but I think you're trying to make the same exact argument people used against shooting games; that it was somehow different because the person was actually involved. And yet the mass violence never materialized. LLMs are easily jailbroken and have been around for ~2 years. Strange we haven't seen a single story about someone committing violent crime because of conversations they had with an AI. You're just the latest generation of hand-wringer. Stop trying to incite moral panic and control others because something makes you uncomfortable.
    - sofixa 1y ago
      > absolutely has to do with your entirely unsupported claim that chatting with an uncensored LLM will cause people to commit violent acts https://www.nytimes.com/2024/10/23/technology/characterai-lawsuit-teen-suicide.html https://www.nytimes.com/2024/10/23/technology/characterai-la... It's a complicated story, but let's not pretend that people can't develop parasocial relationships with AIs and act on them.

vasco 1y ago

I've never encountered a single example of "but it can inspire them to kill themselves" that didn't seem completely bullshit. It just sounds the same as video games creating school shooters or metal music making teenagers satanic. It's gotten to the point where people are afraid of using the word suicide lest someone will do it just because they read the word.

threeseed 1y ago
There is a world of difference between metal music making teenagers satanic and an LLM giving explicit, detailed and actionable instructions on how to sexual assault someone.
- vasco 1y ago
  I'm not sure lack of instructions ever was an issue, and it seems very strange to think that the existence of instructions would be enough of a trigger for a normal person to go and commit this type of crime, but what do I know!
  - threeseed 1y ago
    But this isn't about normal people. It's about people who maybe easily susceptible or mentally impacted who are now provided with direct, personalised instructions on how to do it, how to get away with it and how to feel comfortable doing it. This is a step far beyond anything we've ever seen in human history before and I fail to see Google's behaviour being anything less than appropriate.
- kortilla 1y ago
  People that want to sexually assault are not limited by lack of instructions.
- lazide 1y ago
  Do you seriously think anyone wanted to sexually assault someone but was flummoxed on how to do it? This is absurd.

KennyBlanken 1y ago

Remember when people said games like CoD would make kids/people want to commit mass shootings and shit? ...and it never happened? And no link between shooting games and IRL shootings was ever found?

threeseed 1y ago
Which has absolutely nothing to do with what we are discussing: General content versus personalised, targeted, actionable and specific content.
- KennyBlanken 1y ago
  It absolutely has to do with your entirely unsupported claim that chatting with an uncensored LLM will cause people to commit violent acts. Books, music (NIN was a popular target), movies, and video games are all things hand-wringingers have said would make people do bad things and predicted an outbreak of violence from. Every single time they're prove wrong. Hand-wringers said rock and roll / Elvis thrusting his hips was going to cause an explosion of teenage sex/pregnancies. Never happened. > General content versus personalised, targeted, actionable and specific content. What the hell does any of that mean? You just vomited a bunch of meaningless adjectives, but I think you're trying to make the same exact argument people used against shooting games; that it was somehow different because the person was actually involved. And yet the mass violence never materialized. LLMs are easily jailbroken and have been around for ~2 years. Strange we haven't seen a single story about someone committing violent crime because of conversations they had with an AI. You're just the latest generation of hand-wringer. Stop trying to incite moral panic and control others because something makes you uncomfortable.
  - sofixa 1y ago
    > absolutely has to do with your entirely unsupported claim that chatting with an uncensored LLM will cause people to commit violent acts https://www.nytimes.com/2024/10/23/technology/characterai-lawsuit-teen-suicide.html https://www.nytimes.com/2024/10/23/technology/characterai-la... It's a complicated story, but let's not pretend that people can't develop parasocial relationships with AIs and act on them.