There's a community project in the Eleuther ai discord that has trained several pythia models on chess games and come out playing it just fine. and they play be

There's a community project in the Eleuther ai discord that has trained several pythia models on chess games and come out playing it just fine. and they play better with increased scale too. Then recently Open ai released GPT-3.5 turbo instruct and that plays chess reliably at around 1800 Elo. So i don't know about "notoriously bad". People probably just overestimate how much chess game data most language models are actually getting. That or chat RLHF tanks chess abilities.