The funny thing is you can do this exact thing when it gives you the right answer, and it will often happily switch to an incorrect answer. This is one of the

The funny thing is you can do this exact thing when it gives you the right answer, and it will often happily switch to an incorrect answer. This is one of the most damning things about LLMs to me - and it doesn't seem to have gotten much better with GPT-4