I guess your choices are fine tune on some RLHF, or system prompt. System prompt being the cheaper option :-). But this is one of those cases where perfection i

I guess your choices are fine tune on some RLHF, or system prompt. System prompt being the cheaper option :-). But this is one of those cases where perfection isn't needed. If someone is trying all out to make it say something wrong, they will find a way to succeed (that also works on Humans)