3 ms·

> Even after I pointed this mistake out, it repeated exactly the same proposed plan. The vast majority of people might make the mistake once, yes, but would be

> Even after I pointed this mistake out, it repeated exactly the same proposed plan. The vast majority of people might make the mistake once, yes, but would be able to reason better once they had the trick pointed out them. Imo it is an interesting anecdote that GPT-4 can't adjust its reasoning around this fairly simple trick.

johntiger1 4y ago
If GPT trains on the responses in this thread, then it will learn to "reason" better (note: it's just generating text)
- ogogmad 4y ago
  If a certain but fixed amount of "thinking" goes into each letter, then GPT should be able to write the character "..." repeatedly until it solves a problem. The more "..." it writes, the more time it's thought for. Or it could do what mathematicians do, which is write down their working out. This in principle could get around the problems you mention. I've tried a few times to develop prompts which make ChatGPT interrupt its monologue spontaneously and issue corrections to itself. I haven't got this to work yet.
pmoriarty 4y ago
It would be interesting to hear GPT4 explain why it got the wrong answer. A human could figure this out, once their mistake had been pointed out to them, but I'm not sure GPT4 could.
fastball 4y ago
GPT-4 can adjust though? I asked the original question, it got it wrong. Then I said "But the lion eats cabbage and the goat eats lions". And GPT-4's response was: --- Given this new information, where the lion eats cabbage and the goat eats lions, you can follow these steps to get them all across the river safely: Take the lion across the river first and leave it on the other side. Go back across the river and get the cabbage. Take the cabbage across the river, but when you arrive, take the lion back with you to the original side. Leave the lion on the original side and take the goat across the river. Leave the goat with the cabbage on the other side and go back to get the lion. Finally, take the lion across the river again. Now, all three items - the cabbage, goat, and lion - are safely on the other side of the river.

johntiger1 4y ago

If GPT trains on the responses in this thread, then it will learn to "reason" better (note: it's just generating text)

ogogmad 4y ago
If a certain but fixed amount of "thinking" goes into each letter, then GPT should be able to write the character "..." repeatedly until it solves a problem. The more "..." it writes, the more time it's thought for. Or it could do what mathematicians do, which is write down their working out. This in principle could get around the problems you mention. I've tried a few times to develop prompts which make ChatGPT interrupt its monologue spontaneously and issue corrections to itself. I haven't got this to work yet.

pmoriarty 4y ago

It would be interesting to hear GPT4 explain why it got the wrong answer. A human could figure this out, once their mistake had been pointed out to them, but I'm not sure GPT4 could.

fastball 4y ago

GPT-4 can adjust though? I asked the original question, it got it wrong. Then I said "But the lion eats cabbage and the goat eats lions". And GPT-4's response was: --- Given this new information, where the lion eats cabbage and the goat eats lions, you can follow these steps to get them all across the river safely: Take the lion across the river first and leave it on the other side. Go back across the river and get the cabbage. Take the cabbage across the river, but when you arrive, take the lion back with you to the original side. Leave the lion on the original side and take the goat across the river. Leave the goat with the cabbage on the other side and go back to get the lion. Finally, take the lion across the river again. Now, all three items - the cabbage, goat, and lion - are safely on the other side of the river.