3 ms·
The issue with the models isn't that they play a bad game, but that they persist in making illegal moves. An average intelligent human can be told the rules of
by foldr 18d ago
The issue with the models isn't that they play a bad game, but that they persist in making illegal moves. An average intelligent human can be told the rules of chess and then play chess, badly, within the rules.
- empath75 18d agoAn average human would have a physical chess board in front of them to remind them of the current state.
- foldr 18d agoSure, but the LLM is free to construct a representation of the chess board and update it as it goes along. It is not in any way banned from using a virtual board, or whatever representation of game state it pleases. AFAIK, current models will still sometimes make illegal moves even if given the entire game state (e.g. in FEN notation), so it is not purely an issue with the models’ ability to keep track of sequences of moves.