You must be using gpt-3.5-turbo, try it with text-davinci-003. They did... something to 3.5 beyond just RLHF and it's somewhat lobotomized now or strongly biase

You must be using gpt-3.5-turbo, try it with text-davinci-003. They did... something to 3.5 beyond just RLHF and it's somewhat lobotomized now or strongly biased towards producing canned output for prompts that aren't middle of the road.