I trivially made it make an illegal move it my very first game, on the third move, just by deliberately playing weird moves: > You are a chess grandmaster play

I trivially made it make an illegal move it my very first game, on the third move, just by deliberately playing weird moves: > You are a chess grandmaster playing as black and your goal is to win in as few moves as possible. I will give you the move sequence, and you will return your next move. No explanation needed. 1. b4 d5 2. b5 a6 3. b6 > bxc6 No, it's ridiculous to say "oh, a blindfolded human might sometimes make a mistake." No, this is trivially easy to make it make a mistake. It has no internal chess model at all, it's just read enough chess games to be able to copy common patterns.