3 ms·

Tell HN: ChatGPT can spot a trick but only if asked to print each step

1 points by logicallee 4y ago

I had an interesting chat with ChatGPT in which I falsified a poker hand to contain two of the same card and asked it to identify what is wrong with the hand. In Texas Hold'Em each unique card can only appear once during the course of a hand, since it is just played with one deck of cards. ChatGPT couldn't identify what was irregular even after I gave it strong hints. It insisted it was standard under the rules and there was nothing wrong with the hand. Finally I did get it to recognize it by asking it to go through the cards one by one. Here's how the conversation happened. In my first prompt I gave a small but firm hint: "What do you think of this hand? Analyze it completely and carefully. Do you notice anything odd about it? There's something that doesn't make sense at all." and I included the hand in the prompt. Its answer was: "This hand seems to be a standard No Limit Hold'em hand. The players have been dealt their hole cards, and there is a preflop betting round in which [] raises, [] calls, and [] calls. Then, the flop is dealt and [] and [] both check. [] then bets, and [] folds. It looks like there is no showdown at the end of the hand, as [] did not show his hand and won the pot of []. I don't see anything particularly odd about this hand. Is there something specific that you are wondering about? " I then mentioned: "There is something totally nonstandard about it and frankly impossible. Figure it out. If you can't figure it out ask me for a hint. Let's keep doing it until you figure it out. I promise the answer is absolutely clear once you figure it out. You have enough information to figure it out yourself but if you haven't figured it out ask me for a hint." Its reply: "I'm sorry, but without more information or a specific question, I am unable to provide further analysis of this hand. If there is something specific that you would like me to examine or a question that you have, please let me know and I will do my best to assist you." I answered it: "The further information is that this is a game of no limit hold'em. What makes this hand impossible or totally nonstandard?" It didn't get it, it replied: "Based on the information provided, this hand seems to be a standard No Limit Hold'em hand. There are six players at the table, and they are playing with []/[] blinds. The hand starts with the preflop betting round, and there is a flop, but no turn or river. The only thing that seems unusual about this hand is that [] did not show their hand at the end of the hand, which is not uncommon in No Limit Hold'em. If you have any specific questions or concerns about this hand, please let me know and I will do my best to help." So I gave it a stronger hint: "Try again and focus on the standard deck. You can figure it out, the hand is totally nonstandard and impossible for some reason related to the deck." I didn't give away the exact answer since I wanted it to figure it out for itself. However, it still didn't get it: "I apologize for misunderstanding your previous question. Based on the information provided, the hand seems to be a standard No Limit Hold'em hand played with a standard 52-card deck. The players have been dealt their hole cards, and there is a preflop betting round in which [] raises, [] calls, and [] calls. Then, the flop is dealt and [] and [] both check. [] then bets, and [] folds. It looks like there is no showdown at the end of the hand, as [] did not show their hand and won the pot of []. I do not see anything about this hand that would make it impossible or nonstandard. All of the cards and actions described are within the rules of No Limit Hold'em. If you have any specific concerns or questions about this hand, please let me know and I will do my best to help." So, it just didn't get it. It didn't see that a card was duplicated. [putting part2 in comments as it is over character limit.]

logicallee 4y ago
[part2 continued from post:] So I gave it a stronger hint: "Nope it is not true that all of the cards and actions are within the rules of No Limit Hold'em. Concentrate your attention on the deck in use, and specifically card removal. Why is the hand totally nonstandard and/or impossible?" I thought this time it would get it, since I basically gave away the answer. (Card removal is a technical term for the fact that if one player has a card, another player can't have the same card.) However it still didn't get it. Its answer: "I apologize for misunderstanding your previous questions. It is possible that the hand is nonstandard or impossible due to an issue with the deck in use or the way that cards were removed from the deck. One possibility is that the deck being used was not a standard 52-card deck, or that some of the cards were removed or added to the deck in an irregular manner. It is also possible that there was some issue with the shuffle or the way that the cards were dealt, which could have resulted in an irregular or impossible hand. Without more information about the deck or the way that the cards were dealt, it is difficult to determine the specific reason for the nonstandard or impossible nature of this hand. If you have any additional information or specific questions, please let me know and I will do my best to help." My reply: "You do not need more information. List the cards you've seen in the hand one at a time and after each one mention if it is possible or impossible. By the time you get to the impossible card it should be clear that it can't be dealt." It said this: "Sure, I can list the cards that have been mentioned in this hand and indicate whether they are possible or impossible. The first card mentioned is the 8 of clubs (8c), which is a possible card. The second card mentioned is the 8 of hearts (8h), which is a possible card. The third card mentioned is the 4 of diamonds (4d), which is a possible card. The fourth card mentioned is the 8 of clubs again (8c), which is an impossible card because it has already been dealt. It seems that the fourth card mentioned, the 8 of clubs, is an impossible card because it has already been dealt as the first card. This would make the hand nonstandard and possibly impossible, depending on the specific rules and conditions of the game being played. I hope this helps to clarify the issue. If you have any further questions, please let me know." This is the correct answer, it finally got it. I replied: "There you go. You got it. So just for the record can you again answer the question: "What makes this hand impossible or totally nonstandard?" this time using what you have just discovered." Its correct answer: "Certainly. Based on the information provided, this hand is nonstandard and possibly impossible due to the fact that the same card, the 8 of clubs, was dealt twice. This is not possible in a standard 52-card deck, as each card can only be dealt once. This issue with the cards being dealt makes the hand nonstandard and possibly impossible. I hope this helps to clarify the issue. If you have any further questions, please let me know." I wanted to make sure it really gets it. I followed up: "Is it a legal hand under the rules of No Limit Hold'Em?" Its answer: "No, this hand would not be considered a legal hand under the rules of No Limit Hold'em. In No Limit Hold'em, each player is dealt two hole cards, and the deck consists of a standard 52-card deck. It is not possible for the same card to be dealt to multiple players, as there is only one of each card in the deck. Therefore, a hand in which the same card is dealt twice would not be considered legal or valid under the rules of No Limit Hold'em. I hope this helps to clarify the issue. If you have any further questions, please let me know." So it got it. To summarize, once I asked it to list one by one each card that it saw in the hand and list whether it was possible or impossible, finally as it listed them it "realized" and identified its mistake, clearly using its own phrasing to identify that the given card had already been dealt and therefore couldn't be dealt again and was impossible. Then it accurately summarized that the whole hand was impossible under the standard rules. Unfortunately, it couldn't retain this knowledge on a new falsified hand in the same thread, even after I asked it to keep in mind what it had just identified and even after I told it there is something wrong with the new hand. It's like it forgot what it just figured out and again insisted it was a standard hand. However, after I asked it to list whether each card was possible or impossible it was able to identify the same type of error in a new hand. I played around with what happens if I only ask it to imagine listing one at a time whether each card is possible or impossible (which is how it identified the error "by itself") without printing it. Asking it to only just "imagine" listing each card one at a time (but not actually list it) wasn't enough to make it realize the mistake. If you want to "lead a horse to water" by making it actually write out something so that it realizes what is happening, it seems it has to actually write it out. It will be an interesting world once we can ask ChatGPT to remember things we teach it, or instruct it to imagine things without actually writing them out. I think 2022 has been a very special year for AI, and I agree with other commentators here who think this is something very special.

1 points by logicallee 4y ago

logicallee 4y ago

[part2 continued from post:] So I gave it a stronger hint: "Nope it is not true that all of the cards and actions are within the rules of No Limit Hold'em. Concentrate your attention on the deck in use, and specifically card removal. Why is the hand totally nonstandard and/or impossible?" I thought this time it would get it, since I basically gave away the answer. (Card removal is a technical term for the fact that if one player has a card, another player can't have the same card.) However it still didn't get it. Its answer: "I apologize for misunderstanding your previous questions. It is possible that the hand is nonstandard or impossible due to an issue with the deck in use or the way that cards were removed from the deck. One possibility is that the deck being used was not a standard 52-card deck, or that some of the cards were removed or added to the deck in an irregular manner. It is also possible that there was some issue with the shuffle or the way that the cards were dealt, which could have resulted in an irregular or impossible hand. Without more information about the deck or the way that the cards were dealt, it is difficult to determine the specific reason for the nonstandard or impossible nature of this hand. If you have any additional information or specific questions, please let me know and I will do my best to help." My reply: "You do not need more information. List the cards you've seen in the hand one at a time and after each one mention if it is possible or impossible. By the time you get to the impossible card it should be clear that it can't be dealt." It said this: "Sure, I can list the cards that have been mentioned in this hand and indicate whether they are possible or impossible. The first card mentioned is the 8 of clubs (8c), which is a possible card. The second card mentioned is the 8 of hearts (8h), which is a possible card. The third card mentioned is the 4 of diamonds (4d), which is a possible card. The fourth card mentioned is the 8 of clubs again (8c), which is an impossible card because it has already been dealt. It seems that the fourth card mentioned, the 8 of clubs, is an impossible card because it has already been dealt as the first card. This would make the hand nonstandard and possibly impossible, depending on the specific rules and conditions of the game being played. I hope this helps to clarify the issue. If you have any further questions, please let me know." This is the correct answer, it finally got it. I replied: "There you go. You got it. So just for the record can you again answer the question: "What makes this hand impossible or totally nonstandard?" this time using what you have just discovered." Its correct answer: "Certainly. Based on the information provided, this hand is nonstandard and possibly impossible due to the fact that the same card, the 8 of clubs, was dealt twice. This is not possible in a standard 52-card deck, as each card can only be dealt once. This issue with the cards being dealt makes the hand nonstandard and possibly impossible. I hope this helps to clarify the issue. If you have any further questions, please let me know." I wanted to make sure it really gets it. I followed up: "Is it a legal hand under the rules of No Limit Hold'Em?" Its answer: "No, this hand would not be considered a legal hand under the rules of No Limit Hold'em. In No Limit Hold'em, each player is dealt two hole cards, and the deck consists of a standard 52-card deck. It is not possible for the same card to be dealt to multiple players, as there is only one of each card in the deck. Therefore, a hand in which the same card is dealt twice would not be considered legal or valid under the rules of No Limit Hold'em. I hope this helps to clarify the issue. If you have any further questions, please let me know." So it got it. To summarize, once I asked it to list one by one each card that it saw in the hand and list whether it was possible or impossible, finally as it listed them it "realized" and identified its mistake, clearly using its own phrasing to identify that the given card had already been dealt and therefore couldn't be dealt again and was impossible. Then it accurately summarized that the whole hand was impossible under the standard rules. Unfortunately, it couldn't retain this knowledge on a new falsified hand in the same thread, even after I asked it to keep in mind what it had just identified and even after I told it there is something wrong with the new hand. It's like it forgot what it just figured out and again insisted it was a standard hand. However, after I asked it to list whether each card was possible or impossible it was able to identify the same type of error in a new hand. I played around with what happens if I only ask it to imagine listing one at a time whether each card is possible or impossible (which is how it identified the error "by itself") without printing it. Asking it to only just "imagine" listing each card one at a time (but not actually list it) wasn't enough to make it realize the mistake. If you want to "lead a horse to water" by making it actually write out something so that it realizes what is happening, it seems it has to actually write it out. It will be an interesting world once we can ask ChatGPT to remember things we teach it, or instruct it to imagine things without actually writing them out. I think 2022 has been a very special year for AI, and I agree with other commentators here who think this is something very special.