3 ms·
> I always had the LLM play as white against Stockfish—a standard chess AI—on the lowest difficulty setting I think the author was comparing against Stockfish
by janalsncm 2y ago
> I always had the LLM play as white against Stockfish—a standard chess AI—on the lowest difficulty setting
I think the author was comparing against Stockfish at a lower skill level (roughly, the number of nodes explored in a move).
- fsndz 2y agoDid the same and gpt-3.5-turbo-instruct still lost all the games. maybe a diff in stockfish version ? I am using stockfish 16
- janalsncm 2y agoHuh. Honestly, your answer makes more sense, LLMs shouldn’t be good at chess, and this anomaly looks more like a bug. Maybe the author should share his code so it can be replicated.