It makes more sense when you assume "safety" means brand safety. You can't sell a white label support chat bot if users can get it to say naughty things and pos

It makes more sense when you assume "safety" means brand safety. You can't sell a white label support chat bot if users can get it to say naughty things and post screenshots to twitter. Nevermind that they could just edit the page to make it say whatever they want, or that the output is just a reflection of the user's input. All of the actually dangerous information is widely available. That's why the LLM knows it in the first place.