4 ms·
This. The author is very generous with their interpretation: > I decided to interpret that as ChatGPT flipping the table and saying “this game is impossible, I
by bloppe 4y ago
This. The author is very generous with their interpretation:
> I decided to interpret that as ChatGPT flipping the table and saying “this game is impossible, I literally cannot conceive of how to win without breaking the rules of chess.”
Kind of sounds like anthropomorphization, but more likely the author just papering over the glaring shortcomings to produce a compelling blog post.
It also sounds like the illegal moves were rather frequent. The 61-legal-move game sounded like an impressive outlier.
- rightbyte 4y agoI think the authors rule is fair. If we interpret illegal moves as getting stuck in an online game, the resulting Elo rating is what it would get. But ye, he is anthropomorphizing alot ...
- bloppe 4y agoThere's no indication that GPT-3.5 was stuck when it tried to make illegal moves. GPT-4 clearly was making illegal moves when it was very much not stuck. It just doesn't know how to play, but the author decided to interpret it as frustration.
- rightbyte 4y agoI meant stuck as "it can't make the move" and would timeout the game if playing online.