3 ms·
Chess ELO is not a proxy for general intelligence because many intelligent people choose to learn things other than chess. But any intelligent person can, if th
by carodgers 17d ago
Chess ELO is not a proxy for general intelligence because many intelligent people choose to learn things other than chess. But any intelligent person can, if they choose, learn chess and play it well.
LLMs cannot do this. They still play very poorly relative to human pros, and even modern LLMs still understand the rules so poorly that they request illegal moves.
Anyone claiming that we should be afraid of a text generator that can't understand the rules of chess is being ridiculous.
- ACCount39 17d agoYou picked a piss poor metric and you are getting piss poor results. You can absolutely train an LLM-based model to be superhuman at chess. We just don't care enough to do so. LLMs being even as good at implicitly tracking chess board states as they currently are is an emergent capability. The difficulty wasn't in "understanding rules of chess" in a long while now.
- carodgers 17d ago"You picked a piss poor metric and you are getting piss poor results." Well, we agree that the results are piss poor, at least.