> if you do chain of thought prompting The fact that you have to prompt it along the way means you are doing some of the reasoning for it. BTW have you tried

> if you do chain of thought prompting The fact that you have to prompt it along the way means you are doing some of the reasoning for it. BTW have you tried giving it bad prompts along the way to try to confuse it instead of helping it? Being able to spot a bad argument is also an important part of using predicate logic. > Do you have an example where it fails? Frankly, I'm too lazy to come up with a novel problem that definitely isn't in its training data. On a side note, did you read the thread a few days ago about "glitch tokens" in ChatGPT? https://news.ycombinator.com/item?id=36242914 https://news.ycombinator.com/item?id=36242914 It really doesn't inspire confidence in its abilities. A regular human visiting r/counting would just go "WTF", figure it's people being weird, and walk away. Exposing ChatGPT to r/counting during training on the other hand, "breaks it". It really shows the limitations of its "reasoning".