It is important to note that the one game provided as evidence of 1800ish rating is an opening blunder by stockfish that has occurred in at least 8000 human gam

It is important to note that the one game provided as evidence of 1800ish rating is an opening blunder by stockfish that has occurred in at least 8000 human games. I would expect GPT-3 to be trained on several explanations of how to punish this specific mistake. In general, I would expect GPT's openings to be higher quality than the rest of its games. The fact that it didn't play any illegal moves and was able to win once it had a +5 advantage is still enough to say it is at least 1400ish in the rest of the game. Some of the other games [0] that the OP imported would not strike me as 1800 level play. In particular, the endgame play is atrociously below that level. None of them are labeled as stockfish vs GPT though. [0]: https://lichess.org/@/grantslatton/imported https://lichess.org/@/grantslatton/imported