4 ms·
> You have no way to know for sure if the human you ask the same question, does either. The human might lie, but they generally don't. An LLM is always confa
by Dylan16807 2y ago
> You have no way to know for sure if the human you ask the same question, does either.
The human might lie, but they generally don't.
An LLM is always confabulating when it explains how it reached a conclusion, because that information was discarded as soon as it picked a word.
The limitations are not in the same ballpark.
- TeMPOraL 2y agoThe human may also be... wrong. Saying things that "feel right", except this one time they're factually wrong. A human can explain their reasoning step by step, if the original reasoning was a System 2, formal, step-by-step process in the first place; otherwise, they're just making shit up after the fact, which feels right, but may or may not be correct (see also the previous paragraph). Note that it's very rare anyone has an interaction with a human that uses this mode of reasoning - it's unnecessary except in special circumstances, usually math-heavy.
- vidarh 2y agoWe have no evidence that humans can even know, much less that they generally don't. And we do have evidence that there are situations where the brain will readily construct an explanation after the fact which can't possibly be true (experiments with split brain patients where researchers tricked one brain half into thinking the other half, and so the brain as a whole, had made a decision while the action was taken by the researchers, and made it explain how it has made the decision) There is no basis for claiming to know that people don't usually make up explanations like this other than when e.g. breaking the process apart and writing it down step by step during. But even then individual decisions are "suspect".