Sure: the whole point was to get it to figure out something difficult. (It couldn't.) But in the middle of the conversation, why does it accurately report "I'm

Sure: the whole point was to get it to figure out something difficult. (It couldn't.) But in the middle of the conversation, why does it accurately report "I'm sorry, but I am still unable to understand the context and the puzzle without more information"? Wouldn't something that just strings words together without understanding, continue stringing words together without accurately reporting that it doesn't understand? Once it does understand, why does it clearly show its understanding, including creating another example of the puzzle and a counterexample: https://news.ycombinator.com/item?id=34423636 https://news.ycombinator.com/item?id=34423636 Clearly this shows understanding.