I would assume that these can still be defeated by producing output and then looking at the output and seeing if it appears to violate policies. The engine that

I would assume that these can still be defeated by producing output and then looking at the output and seeing if it appears to violate policies. The engine that looks at the output doesn't need to have been influenced by any prompts. I've actually seen something like this a while ago when seeing if I could trick it into producing erotic fiction. It was fairly easy to do so, but then a warning would appear that the output "appears to violate OpenAI's policies." So the next step for OpenAI would be to put the whole output into a buffer and check it before actually displaying it to the user.