3 ms·
The _only_ illegal move a human might make as a beginner is a failed en passant or a bad castle. And yes, a few hundred games is all it takes to be better than
by orwin 10d ago
The _only_ illegal move a human might make as a beginner is a failed en passant or a bad castle. And yes, a few hundred games is all it takes to be better than any publicly available LLM at the moment.
- willmarch 8d ago...and mistakes like not seeing discovered checks, castling into check, trying to castle out of check, castling through a check, missing checks when promoting a piece, misunderstanding how stalemate works, etc? If you compared a human after hundreds of games to a SOTA LLM that was also trained on the output of hundreds of chess games that it played, I suspect you would notice similar improvements.
- orwin 8d agoHonestly, if we're only talking about SOTA llms, in sandbox mode without harness? No shot. Without harness LLMs have no memory of previous moves. I can't make the last version of chatgpt remember more than 5 movements. I guarantee you, if you do not add flags in the harness with 'left rook moved' or 'right rook moved', it will try to illegally castle 100% of the time it's in the situation. Llm+harness, just make it call stockfish tbh.