I don't get this obsession with actually preventing AI models from generating 'offensive' content. The models have been trained on a big chunk of the internet,

I don't get this obsession with actually preventing AI models from generating 'offensive' content. The models have been trained on a big chunk of the internet, and so are bound to contain all the 'points of view', however dismal, therein. People need to understand that, just like you can get 'offensive' content in google search (and should be able to), if you really try. Surely we should be aiming for a default 'decent' moderation, but if you really want to slop around at the bottom of the barrel by carefully crafting input (aka 'jailbreaking'), that's on you.