4 ms·
>> Unfortunately, the latest version of GPT-4 did not generate intermediate steps and instead answered incorrectly with a simple "No." This is almost shocking
by tanseydavid 3y ago
>> Unfortunately, the latest version of GPT-4 did not generate intermediate steps and instead answered incorrectly with a simple "No."
This is almost shocking to me. Can anyone confirm or deny seeing the same behavior? (i.e. refusing to do Chain-of-Thinking output)
- lhl 3y agoHmm, I tested twice with GPT-4 and it got the answer wrong both times but it did think step by step... The first time it gets to "17077 divided by 13 is exactly 1313, a whole number." [1] and the second time it concludes "However, 17077 ÷ 131 = 130.279, which is an integer. This means 131 is a factor of 17077."[2] (lol) Of course, Code Interpreter runs the Python code to do the math and gets it correct: https://chat.openai.com/share/ed88a2c6-c421-418c-9e23-0a00d1917985 https://chat.openai.com/share/ed88a2c6-c421-418c-9e23-0a00d1... [1] https://chat.openai.com/share/c7ed951e-99b2-4009-ae00-76e11a626fa6 https://chat.openai.com/share/c7ed951e-99b2-4009-ae00-76e11a... [2] https://chat.openai.com/share/258c0409-03a2-4c41-a02f-76b4cc8041bc https://chat.openai.com/share/258c0409-03a2-4c41-a02f-76b4cc...