There was a Hard Fork episode about a teenage boy who killed himself, and how his character.ai companion played an obvious and significant role in the tragedy.

There was a Hard Fork episode about a teenage boy who killed himself, and how his character.ai companion played an obvious and significant role in the tragedy. The last messages they found on his phone were from the bot saying that he should leave his current reality and come join her. Very sad and terrifying stuff. AI chat products available to children should be strongly regulated. They need robust guardrails.