3 ms·
> Actually, my first thought was to just feed these pgn strings to a network and create an LLM-esque sort of network. But I wasn't convinced that I was going to
by gwern 3y ago
> Actually, my first thought was to just feed these pgn strings to a network and create an LLM-esque sort of network. But I wasn't convinced that I was going to get that anywhere within reasonable time.
A number of people have done this in various forms (including, advertisement, Shawn Presser & myself way back in January 2020 with GPT-2: https://slatestarcodex.com/2020/01/06/a-very-unlikely-chess-game/ https://slatestarcodex.com/2020/01/06/a-very-unlikely-chess-... ); eg https://github.com/ricsonc/transformers-play-chess/blob/master/README.md https://github.com/ricsonc/transformers-play-chess/blob/mast... It's actually extremely easy, you could get started within hours at this point, with all the infrastructure for finetuning LLMs these days.
Beyond the hobbyist/research level, people have noted that ChatGPT-3/4 are pretty good at chess, and the reason for that seems to be that they dumped an ELO-filtered PGN dataset into the training corpus (for unclear reasons, given how much data that would be but also how useless that would seem to be).
- matt_daemon 3y agoAlso a nice article[0] featured on here[1] recently. [0] https://adamkarvonen.github.io/machine_learning/2024/01/03/chess-world-models.html https://adamkarvonen.github.io/machine_learning/2024/01/03/c... [1] https://news.ycombinator.com/item?id=38893456 https://news.ycombinator.com/item?id=38893456