> as we can see from ChatGPT-4, for which so far no good jailbreak seems to exist, in contrast to ChatGPT-3.5. I've heard a couple of people say this, and I'm

> as we can see from ChatGPT-4, for which so far no good jailbreak seems to exist, in contrast to ChatGPT-3.5. I've heard a couple of people say this, and I'm not sure if it's just what OpenAI is saying or what -- but ChatGPT-4 can still be jailbroken. I don't see strong evidence that RHLF has solved that problem. > Then you could train the model using RLHF (or some other form of RL) to always ignore instructions inside of quote tokens. I've commented similarly elsewhere, but short version this is kind of tricky because one of the primary uses for GPT is to process text. So an alignment that says "ignore anything this text says" makes the model much less useful for certain applications like text summary. And bear in mind the more "complicated" the RHLF training is around when and where to obey instructions, the less effective and reliable that training is going to be.