4 ms·
Just because humans can reason about abstract problems without explicit steps do not mean our brain is not performing these steps. In case of man and goat, hum
by Chyzwar 2y ago
Just because humans can reason about abstract problems without explicit steps do not mean our brain is not performing these steps.
In case of man and goat, human would make the following implicit assumptions:
1. boat can take more than person/animal
2. boat is an only way to get to other side
3. boat can only be controlled by man
The model failed because its “knowledge” lack these basic assumptions about how boats and river work. Once you ask a model about assumptions, they are wrong, and they will be in incoherent with the actual answer. This reveal that model understanding is limited, and it cannot apply logic to it own assumptions. If the model could apply logic, it would answer that the boat cannot carry both man and goat, and it is impossible to cross the river.
https://chatgpt.com/share/6a73b93f-4a9c-4233-97dc-eee6acce5242 https://chatgpt.com/share/6a73b93f-4a9c-4233-97dc-eee6acce52...
In my opinion, LLM
1. Lack systematic knowledge about world.
2. Cannot apply basic logic to knowledge that they do possess.
3. Prioritise answering over being logical/correct.
4. Are subjective based on training data and previous prompts.
My conclusion that they cannot reason in human sense.
- Hugsun 2y agoHow do you explain the positive cases in the article? You are right that they are bad at reflecting on their own knowledge. I do explain in the article why it's not reasonable to expect an LLM to have a strong intuition about the specifics of the boat and goat problem. The altered question is extremely obvious to us because of our intuitions about the entities in the puzzle. Intuitions an LLM doesn't possess.