4 ms·
AI companions are final stage of digital addiction, and lawmakers are taking aim
- droopyEyelids 2y ago(Not an AI stan) I would like to see the evidence that the AI contributed to the suicide. Without seeing the evidence this feels like a cynical attempt to make political hay out of a tragedy. The person whose AI companion forms their most important social connection is already not doing well psychologically. And from what I’ve seen, they only offer salubrious advice.
- Bacup 2y agoHere is an article by CNN about the suicide with glimpse of conversation between the teen and the chatbot. https://edition.cnn.com/2024/10/30/tech/teen-suicide-character-ai-lawsuit/ https://edition.cnn.com/2024/10/30/tech/teen-suicide-charact... I personnaly think it's like the relation between some massacre and videogames, where the attackers were already mentaly ill before committing the act. But I wonder, we know people (even kids) can make a difference between reality and a videogame. But will we be able to make a difference between a chatbot and a real human ?
- Grimblewald 2y agoHumans tend to be less sycophantic than llms in my experience.
- Havoc 2y agoVery hard to tell which way causality goes on that though.
- alganet 2y agoIt doesn't make any sense. No one in their right minds would want such a product. Seems like the industry is too high on their own control fantasies to discern what people want.
- doright 2y agoThere are a lot of people in their wrong minds, and the industries market to them, intentionally or not. I have been one of them for a time although I somehow resist AI companionship. Companies aren't going to learn the stories of every depressed addict with a rough home life; so long as those addicts throw money at the service they see no issue. Mental health needs to be addressed before the propensity for someone to be addicted to AI chatbots can develop at all. By the time someone's AI addiction needs to be addressed, something has already gone wrong. The same goes for tobacco/heroin/gambling/other addictive substances. It's not very different in practice for AI chatbots. It fills a personal void in someone's life. That void is not usually discussed when building up regulatory frameworks to address the symptoms of despair.
- alganet 2y agoI don't think AI addiction is actually a thing. Whoever is using chatbots obsessively, is using on others, not on themselves. Not to fill a void, but to play and harass other humans. "Digital waifus" are old decade stuff, a very narrow market that has very low value. Those people aren't even addicted, it has become a healthy hobbyst culture. If you are serious about mental health, the real issue right now is the growing "incel" supergroup of targeted "dangerous" personas. That also has nothing to do with addiction. Those kids need real friends, AI companions _will_ be an extra insult to them, not a pax to fill some hypothetical void. They are not lonely and sad (that's the label people put on them), they are desensitized.
- squigz 2y ago> the real issue right now is the growing "incel" supergroup of targeted "dangerous" personas Can you elaborate on this, particularly on how we might solve that issue?
- alganet 2y agoSure. To solve it powerful people need to stop using younger generations as personality cannon fodder for cultural and political disputes.
- throwaway81523 2y agoThere was a really good novel, "The Diamond Age" by Neal Stephenson, that had a subplot about digital teachers for schoolkids as a subersive/revoluationary scheme against those not willing to educate the kids. It didn't discuss crappification though. Gladiator at Law by Pohl and Kornbluth was also pretty good. Computerized jury trials. The "jury box" turned out to be a computer.
- Havoc 2y agoMust admit I don’t quite understand how people connect to these things like that. To me it just feels super hollow since the companion has no independent life. Simple human interactions like “how was your day” has no meaning in that context. It just echos back what you’re bringing up with little to no autonomous agency