4 ms·
> There’s a phenomenon called “chain of thought” where large AI language models perform much, much better if given prompts like “Think about it carefully and sh
by Ukv 4y ago
> There’s a phenomenon called “chain of thought” where large AI language models perform much, much better if given prompts like “Think about it carefully and show your steps.” Mathematical word problems that trip up ChatGPT normally get conquered if such a prompt is added. Except when they don’t.
With the way these models work, I'd assume that the benefit from chain-of-thought only happens when it gives the steps first (and so can base its final answer off of those intermediate steps), rather than the example in the article where it gives the answer first (and then has to generate steps to reach that answer without being able to change the answer).
When I tried the same prompt as in the article, ChatGPT explained its steps before giving the answer and was correct: https://i.imgur.com/lLS2xCX.png https://i.imgur.com/lLS2xCX.png
You could probably push it in this direction through the prompt ("show your steps before giving the final answer").
- Eliezer 4y agoThis, indeed, is a mistake many humans also make. But it's a sharper and more beautiful illustration in AI format - that as soon as the AI outputs an answer, the intelligence of that answer is fixed in place, and no rationalizing output appended afterward makes the answer any less dumb. Maybe some humans will learn from it.
- LordDragonfang 4y agoCan I just say that it's both surreal and ironic seeing you be able to criticize an AI for not Holding Off On Proposing Solutions - and I can only imagine how surreal it must be for you.
- 9991 4y agoWow
- deleted 4y ago[deleted]
- II2II 4y agoI had a similar experience with ChatGPT. I asked it to calculate the first 10 digits of pi in C, then the first 100 digits. Unfortunately, the only difference between the program was the printf() format: it went from %.10f to %.100f. So I prompted it with: > Doubles do not have 100 digits of precision in C. Can you write a program to calculate the first 100 digits of Pi in C that takes the precision of data types into consideration? I was surprised that it made sense of that request and returned another program using an arbitrary precision library. When it did not work, I told it where the error was and it gave a probable cause for the error. Again, rather impressive.
- jaredsohn 4y agoI just went through the same first two prompts and it gave me your answer to the second prompt without me having to clarify it. That impresses me as well.
- chii 4y agoi wonder what would happen if you asked it to try and prove a currently unknown mathematical theorem such as the Riemann hypothesis.
- II2II 4y agoIt says what the Riemann hypothesis is and that it has not been proven. Even if you broke the problem into (already proven) steps that may lead to a proof, you would need a strong background in mathematics simply to verify anything it claims.
- SV_BubbleTime 4y agoBut the confidence in its answer is through the roof! So, you know, just trust it!
- II2II 4y agoChatGPT sounds as confident as a person presenting an incorrect answer. Which is ironic, since it can probably calculate how confident it is. I have included part of a transcript where ChatGPT bounces between two answers (likely the two answers it has confidence in) even though it is told that both answers are incorrect. In other cases, it insisted upon a singular answer. (Sorry about editing out blocks. ChatGPT is verbose. I limited the removal to background material about the book.) Here is the excerpt: II2II: What was Polyanna glad about when she received crutches? ChatGPT: In the novel "Polyanna," the character Pollyanna becomes severely injured in an accident and is confined to bed for several months. Eventually, she is fitted with crutches and learns to walk again, but she faces many challenges and setbacks along the way. (...) II2II: But Polyanna received the crutches before the accident. ChatGPT: I apologize for the mistake in my previous response. You are correct that Pollyanna receives the crutches before the accident in the novel "Polyanna." ChatGPT: In the novel, Pollyanna is given the crutches as a gift by her wealthy but unhappy aunt, who is trying to cheer her up after her father's death. At first, Pollyanna is confused and disappointed by the gift, as she is not sure what to do with the crutches. However, she eventually realizes that the crutches can be used as props in a game that her father taught her called the "Glad Game." (...) II2II: Are you sure the aunt gave Polyanna crutches? ChatGPT: I apologize for the error in my previous responses. You are correct that Pollyanna does not receive crutches as a gift in the novel "Polyanna." ChatGPT: In the novel, Pollyanna becomes severely injured in an accident and is confined to bed for several months. Eventually, she is fitted with crutches and learns to walk again, but she faces many challenges and setbacks along the way. Despite these challenges, Pollyanna remains optimistic and cheerful, and she tries to find something positive to focus on in every situation. (...) II2II: Both of the answers you have given incorrect. The first answer is incorrect because she received the crutches before the accident. The second answer is incorrect because she received the crutches before her father's death. Can you think of another answer? ChatGPT: I apologize for the errors in my previous responses. You are correct that Pollyanna receives the crutches before the accident and before her father's death in the novel "Polyanna." ChatGPT: In the novel, Pollyanna is given the crutches as a gift by her wealthy but unhappy aunt, who is trying to cheer her up after her father's death. At first, Pollyanna is confused and disappointed by the gift, as she is not sure what to do with the crutches. However, she eventually realizes that the crutches can be used as props in a game that her father taught her called the "Glad Game." (...)
- amelius 4y agoYou can also take the output and ask "explain why this answer is correct/wrong", etc.