From the README: >Per move, a model gets 5 illegal moves before forced resignation of the round. >Most of gpt-4's losses were due to illegal moves, so it may

From the README: >Per move, a model gets 5 illegal moves before forced resignation of the round. >Most of gpt-4's losses were due to illegal moves, so it may be possible to come up with a prompt to have gpt-4 correct illegal moves and improve its score. My experience exactly with gpt4. I first solved by keeping a list of illegal moves and subsequently prompting to move again and explicitly exclude those moves. Idea was to constrain gpt as little as possible, but that became inefficient. So I began to prompt for each move with the complete set of legal moves to choose from. In any case, at a certain point it becomes somewhat random when the goal is just to produce a legal move. But, it's interesting that producing legal moves is a challenge for gpt4, especially given that it's such a discrete problem.