>No one designed it SPECIFICALLY to do that, It's true that there's emergent behavior on YT that nobody accounted for, but there's one big qualitative differen

>No one designed it SPECIFICALLY to do that, It's true that there's emergent behavior on YT that nobody accounted for, but there's one big qualitative difference, you can at least specifically shut it down and hold the creator accountable. And at least in principle, if we lived in a culture where we'd hold businesses accountable for what they unleash on the world, if YT wanted to they could create some rather harsh and effective punishments to get that stuff off the site in the first place. Just imagine if a real person had messaged a minor and told them to kill their parents. That's a crime. With chatbots like this not only do they do unpredictable things, you can't even predictably remove those parts. Like the sorcerer's apprentice you basically have to perform some incantations and hope it works, which is just an absurd way to interact with a tool that has the potential to tell a kid to kill his parents. Would we sell a saw that has a chance to saw your finger off if you argue with it the wrong way?