They are, because at some point, your AI will say some terrible things, journalists will pick it up, at it will be a PR disaster. It doesn't take much, if you f

They are, because at some point, your AI will say some terrible things, journalists will pick it up, at it will be a PR disaster. It doesn't take much, if you find a seemingly innocuous prompt that results in you system answering that raping children is super cool, it will be called "the pedophile AI" in no time, even if it is an extremely rare and provoked occurrence. No one wants that, it may even cause major legal trouble for the company and affect the entire field. Note that while OpenAI is pretty lenient when it comes to jailbreaks, the do ban users who go too far. I think jailbreaks get a pass because it helps them fine tune their systems, also when you paste an entire page of text with convoluted language to make it say bad things, that makes it obvious you asked for it and that you are not an innocent victim.