3 ms·

https://edition.cnn.com/2024/10/30/tech/teen-suicide-character-ai-lawsuit/index.html https://edition.cnn.com/2024/10/30/tech/teen-suicide-charact... there are

• techjamie 2y ago
  https://nypost.com/2024/10/23/us-news/florida-boy-14-killed-himself-after-falling-in-love-with-game-of-thrones-a-i-chatbot-lawsuit/ https://nypost.com/2024/10/23/us-news/florida-boy-14-killed-... This article has screenshots from the conversation. While the outcome is definitely more extreme, the actual conversation between him and the bot when it came to the message that encouraged him to go through with it is a little more questionable. He didn't ask it if he should kill himself directly, he told it he was going to "come home" to it, and it told him that he should. But the bot being a roleplay bot could easily respond as if that's just a part of the roleplay, and his character was literally going home. It isn't responding with a prompt indicating that it's responses might effect a real person that way. I would say what could really make it damning depends on the rest of the conversation, which will likely come out in court, and seeing if suicidal tendencies are present within its context window.
  • Ferret7446 2y ago
    The other problem is that this is for roleplaying. What if you wanted to roleplay a suicidal couple situation? To what extent should websites be legally obligated to verify the mental condition of its visitors?