It's a bit odd requirement, but.. OK. I mean who is the malicious actor here, the AI, the human user or the AI provider? If the AI, then we shouldn't give it a

It's a bit odd requirement, but.. OK. I mean who is the malicious actor here, the AI, the human user or the AI provider? If the AI, then we shouldn't give it an agency (user should always vet the output). If it's the user, the AI is irrelevant to the question. And if it's AI provider, why would they train AI on such materials in the first place. The whole enterprise of this kind of safety doesn't make much sense to me. If the AI is not able to follow so clear user instructions it's not ready for prime time and must be under human supervision at all times. (And subtle hallucinations on topic seem to be both more dangerous and more of a problem than blatant random production of explicit images, anyway.)