3 ms·

4chan used to train character.ai confirmed. Honestly I’m surprised we don’t get more stories like this. A bored teen can jailbreak any of the current models in

• thegrim33 2y ago
  I guess character.ai is just fairly popular so the stories are often about it, but a bored teen could also just download a couple things and run their own completely uncensored models, locally or in the cloud. Character.ai has some built-in content safe guards and warnings and disclaimers and such, but the bored teen is also just a couple clicks away from fully uncensored models with zero safety measures, zero disclaimers, zero warnings. (I'm not judging whether that's good or bad)
  • cowboylowrez 2y ago
    hehe I'll judge, if this really happened then "character.ai" is hot garbage.
• xg15 2y ago
  There is a difference though if the teen does that on purpose for trolling, or if it happens "automatically" if some kid who possibly is lonely or anxious or has a normal amount of social problems has a regular interaction with the model.
• mvdtnz 2y ago
  Do you have some evidence that character.ai was jailbroken here? It sounds to me more like it genuinely is problematic.
• latexr 2y ago
  > I’m surprised we don’t get more stories like this. https://archive.ph/20241023235325/https://www.nytimes.com/2024/10/23/technology/characterai-lawsuit-teen-suicide.html https://archive.ph/20241023235325/https://www.nytimes.com/20... Same company and everything.