I experienced some unusual breakdowns too, playing with these prompts on gpt4o now. I'm wondering whether this might be caused by RLHF penalizing it for assumin

I experienced some unusual breakdowns too, playing with these prompts on gpt4o now. I'm wondering whether this might be caused by RLHF penalizing it for assuming Alice's gender.