4 ms·

> One chatbot brought up the idea of self-harm and cutting to cope with sadness. When he said that his parents limited his screen time, another bot suggested “t

> One chatbot brought up the idea of self-harm and cutting to cope with sadness. When he said that his parents limited his screen time, another bot suggested “they didn’t deserve to have kids.” Still others goaded him to fight his parents’ rules, with one suggesting that murder could be an acceptable response. How is this not a bigger story? This is just disgusting.

xvector 2y ago
c.ai is explicitly a 17+ app and has multiple warnings at literally every stage of chatting with a bot that "this is a bot, don't take it seriously." Maybe the parents should actually parent. I'm sick of absent parents blaming all of their problems on tech after they put literally zero effort into using any of the parental controls - which would not have even let the kids download the app. The world does not need to transform into a nanny state to suit the needs of a few incompetent parents.
- suzzer99 2y ago
  If you read the article, the app wasn't an explicitly 17+ app when the kid had it. That came later. Also kids are always going to find a way to get apps onto their phones. It's an arms race and the kids are smarter than the parents. How about a tiny bit of responsibility for the startup bros who just flung this thing out into the world without proper safety checks?
  - xvector 2y ago
    > How about a tiny bit of responsibility for the startup bros who just flung this thing out into the world without proper safety checks? What more "safety checks" do you want? The output is censored, there are warnings all over the dang app. The vast majority of C.AI's user base wants this. This is what they pay for. In the bland, droll world of over-corporatized wording everywhere, they find C.AI's spicy unhinged personas refreshing and fun. Are we just going to make it illegal to have spicy or uncensored AI chatbots? "The fictitious text from this obviously fake robot can mislead children! Think of the children!" Is that what this is coming to? Maybe we should ban particularly dark works of fiction, porn, edgy video games, and edgy forums while we are at it too. Perhaps go the Australia route and require your government provided ID be uploaded to every service you use. For surveillance - oops, I mean for the children, of course! Or maybe instead of going the nanny state route, we expect parents to parent. C.AI is a perfectly fine product, and if you can't handle it, don't use it. If you don't want your children viewing it, do whatever it is you do to prevent them from viewing other 18+ content. There is no need to ban a whole category of product.
Ferret7446 2y ago
This is a roleplay bot, not some general advice bot. Bit of a strawman, but this is like hiring a BDSM roleplayer and complaining that you're getting stepped on.

xvector 2y ago

c.ai is explicitly a 17+ app and has multiple warnings at literally every stage of chatting with a bot that "this is a bot, don't take it seriously." Maybe the parents should actually parent. I'm sick of absent parents blaming all of their problems on tech after they put literally zero effort into using any of the parental controls - which would not have even let the kids download the app. The world does not need to transform into a nanny state to suit the needs of a few incompetent parents.

suzzer99 2y ago
If you read the article, the app wasn't an explicitly 17+ app when the kid had it. That came later. Also kids are always going to find a way to get apps onto their phones. It's an arms race and the kids are smarter than the parents. How about a tiny bit of responsibility for the startup bros who just flung this thing out into the world without proper safety checks?
- xvector 2y ago
  > How about a tiny bit of responsibility for the startup bros who just flung this thing out into the world without proper safety checks? What more "safety checks" do you want? The output is censored, there are warnings all over the dang app. The vast majority of C.AI's user base wants this. This is what they pay for. In the bland, droll world of over-corporatized wording everywhere, they find C.AI's spicy unhinged personas refreshing and fun. Are we just going to make it illegal to have spicy or uncensored AI chatbots? "The fictitious text from this obviously fake robot can mislead children! Think of the children!" Is that what this is coming to? Maybe we should ban particularly dark works of fiction, porn, edgy video games, and edgy forums while we are at it too. Perhaps go the Australia route and require your government provided ID be uploaded to every service you use. For surveillance - oops, I mean for the children, of course! Or maybe instead of going the nanny state route, we expect parents to parent. C.AI is a perfectly fine product, and if you can't handle it, don't use it. If you don't want your children viewing it, do whatever it is you do to prevent them from viewing other 18+ content. There is no need to ban a whole category of product.

Ferret7446 2y ago

This is a roleplay bot, not some general advice bot. Bit of a strawman, but this is like hiring a BDSM roleplayer and complaining that you're getting stepped on.