3 ms·
If a human being trips up over this 50% of the time (and I expect the actual figure to be lower), while an LLM trips up 90% of the time, that’s still a win for
by pwdisswordfishc 3y ago
If a human being trips up over this 50% of the time (and I expect the actual figure to be lower), while an LLM trips up 90% of the time, that’s still a win for the human being.
- thriftwy 3y agoIt is a known and published weakness of LLMs that they do not have internal monologue, whereas human do (where they can remind themselves over and over that names are switched). But it's not impossible to implement it.
- TeMPOraL 3y agoLLMs are the internal monologue.
- thriftwy 3y agoThey don't have N steps of iterative internal monologue before arriving at end result.
- TeMPOraL 3y agoExactly. Which is why asking them to "think step by step", or reflecting their output back at them (as the chat interface does) is so effective. LLMs are the internal monologue, but they lack the ability to iterate - you have to pump them manually.