4 ms·
It is a known and published weakness of LLMs that they do not have internal monologue, whereas human do (where they can remind themselves over and over that nam
by thriftwy 3y ago
It is a known and published weakness of LLMs that they do not have internal monologue, whereas human do (where they can remind themselves over and over that names are switched). But it's not impossible to implement it.
- TeMPOraL 3y agoLLMs are the internal monologue.
- thriftwy 3y agoThey don't have N steps of iterative internal monologue before arriving at end result.
- TeMPOraL 3y agoExactly. Which is why asking them to "think step by step", or reflecting their output back at them (as the chat interface does) is so effective. LLMs are the internal monologue, but they lack the ability to iterate - you have to pump them manually.