We should remember that, thanks to RLHF, ChatGPT has received a ton of feedback on the correct way to solve common benchmark problems. I have seen multiple ins

We should remember that, thanks to RLHF, ChatGPT has received a ton of feedback on the correct way to solve common benchmark problems. I have seen multiple instances in which it got a problem laughably wrong, this got publicized, then days or hours later it was always giving the right answer.