5 ms·

One the other hand, I've not yet gotten it to play a successful game of tic-tac-toe (if it can play correctly at all, it plays exceedingly poorly and its descri

One the other hand, I've not yet gotten it to play a successful game of tic-tac-toe (if it can play correctly at all, it plays exceedingly poorly and its descriptions of its moves often have no relation to the moves it actually made). So your mileage may vary.

consumer451 4y ago
That's interesting, I just tried twice and it worked very well until the winning move where it lost track of everything. Please note that I am using vanilla chat.openai.com. (Mar 23 version) I asked for an ascii representation in each response to keep the current state in "mind." > Do you know the rules to the game tic-tac-toe? >> Yes, I do! Tic-tac-toe is a two-player game played on a 3x3 grid. The players take turns marking either an "X" or an "O" in an empty square on the grid until one player gets three of their marks in a row, either horizontally, vertically, or diagonally. The first player to get three in a row wins the game. If all squares on the grid are filled and no player has three in a row, the game ends in a draw. > can you play the game with me displaying the game as ascii in each response? I am curious what prompts you used.
- ldhough 4y ago
  I've tried tic-tac-toe with it (GPT4, web platform - maybe results are different with the API and temp 0?) easily a dozen times using various ways to prompt it over the past few weeks, it only played well once so I'm assuming it was just luck. I usually have it go first and start with X but have tried O. It usually makes no attempts to block 3 in a row, even if I tell it "try to win," "block me from winning," etc. Once it told me I won without having 3 in a row, many times it plays after I've already won and then tells me I've won, though usually it does manage to recognize a win condition. Today I tried asking it "do you know the optimal strategy?" and it explained it but claimed that it hadn't been using it to make the game "more fun for me" (honorable but I'd already told it to try to win) and asked if I wanted it to play optimally. It tried and ended up claiming we had a draw because neither of us achieved a win condition even though I'd won and it just played after the game was over. Various strategies include asking it to draw ASCII, provide moves in symbol-location notation, ex: X5, asking it how to play, telling it to try to win, etc. I do find it very odd that it is so poor at tic-tac-toe, it seems to even handle seemingly novel games better.
- naet 4y ago
  I just tried to play a game with simple open-ended prompts and it sort of worked, but not really (which sums up most of my chatgpt experience). Here is the log: https://pastebin.com/raw/gUYEkyw9 https://pastebin.com/raw/gUYEkyw9 It set up the game very well with a representation of the board, and even provided a system for us to input our moves. It doesn't seem to totally get the idea of taking turns though; at first it doesn't go unless prompted, then it prompts me to move twice in a row. Then after a few turns it claims to have won when it hasn't got three in a row, and when I tell it that it hasn't won, it makes another move on top of one of my moves and claims to have won again (at least this time with three in a row, if you ignore that it made an illegal move). At this point I stopped trying to play.
int_19h 4y ago
Are you trying to use an actual 2D board representation in text to play? In my experience, GPT-3.5 specifically is pretty bad at tasks that require spatial reasoning, even very basic ones.
- 6177c40f 4y ago
  I've done it both ways, while GPT-4 seems to be better at sticking to valid moves, neither play well, and neither noticed when I won. If you claim victory at any point, they'll congratulate you and concede the game, which is pretty funny.

consumer451 4y ago

That's interesting, I just tried twice and it worked very well until the winning move where it lost track of everything. Please note that I am using vanilla chat.openai.com. (Mar 23 version) I asked for an ascii representation in each response to keep the current state in "mind." > Do you know the rules to the game tic-tac-toe? >> Yes, I do! Tic-tac-toe is a two-player game played on a 3x3 grid. The players take turns marking either an "X" or an "O" in an empty square on the grid until one player gets three of their marks in a row, either horizontally, vertically, or diagonally. The first player to get three in a row wins the game. If all squares on the grid are filled and no player has three in a row, the game ends in a draw. > can you play the game with me displaying the game as ascii in each response? I am curious what prompts you used.

ldhough 4y ago
I've tried tic-tac-toe with it (GPT4, web platform - maybe results are different with the API and temp 0?) easily a dozen times using various ways to prompt it over the past few weeks, it only played well once so I'm assuming it was just luck. I usually have it go first and start with X but have tried O. It usually makes no attempts to block 3 in a row, even if I tell it "try to win," "block me from winning," etc. Once it told me I won without having 3 in a row, many times it plays after I've already won and then tells me I've won, though usually it does manage to recognize a win condition. Today I tried asking it "do you know the optimal strategy?" and it explained it but claimed that it hadn't been using it to make the game "more fun for me" (honorable but I'd already told it to try to win) and asked if I wanted it to play optimally. It tried and ended up claiming we had a draw because neither of us achieved a win condition even though I'd won and it just played after the game was over. Various strategies include asking it to draw ASCII, provide moves in symbol-location notation, ex: X5, asking it how to play, telling it to try to win, etc. I do find it very odd that it is so poor at tic-tac-toe, it seems to even handle seemingly novel games better.
naet 4y ago
I just tried to play a game with simple open-ended prompts and it sort of worked, but not really (which sums up most of my chatgpt experience). Here is the log: https://pastebin.com/raw/gUYEkyw9 https://pastebin.com/raw/gUYEkyw9 It set up the game very well with a representation of the board, and even provided a system for us to input our moves. It doesn't seem to totally get the idea of taking turns though; at first it doesn't go unless prompted, then it prompts me to move twice in a row. Then after a few turns it claims to have won when it hasn't got three in a row, and when I tell it that it hasn't won, it makes another move on top of one of my moves and claims to have won again (at least this time with three in a row, if you ignore that it made an illegal move). At this point I stopped trying to play.

int_19h 4y ago

Are you trying to use an actual 2D board representation in text to play? In my experience, GPT-3.5 specifically is pretty bad at tasks that require spatial reasoning, even very basic ones.

6177c40f 4y ago
I've done it both ways, while GPT-4 seems to be better at sticking to valid moves, neither play well, and neither noticed when I won. If you claim victory at any point, they'll congratulate you and concede the game, which is pretty funny.