4 ms·
« saying that it thought » This is, quite literally, not something that ChatGPT has the capability to do -- reporting on its thought process, that is. This is
by phyzome 2y ago
« saying that it thought »
This is, quite literally, not something that ChatGPT has the capability to do -- reporting on its thought process, that is. This is a hallucination.
- HappMacDonald 2y agoMost human self-reflection and to an extent even memory is similarly post-facto, however.
- layer8 2y agoHumans do tend to remember thoughts they had while speaking, thoughts that go beyond what they said. LLMs don’t have any memory of their internal states beyond what they output. (Of course, chain-of-thought architectures can hide part of the output from the user, and you could declare that as internal processes that the LLM does “remember” in the further course if the chat.)
- casey2 2y agoIs it a thought you had or a thought that was generated by your brain? In any case the end result is the same. You can only infer from what was generated
- layer8 2y agoYou can only infer from what is remembered (regardless of whether the memory is accurate or not). The point here is, humans regularly have memories of their internal processes, whereas LLMs do not. I don't see any difference between "a thought you had" and "a thought that was generated by your brain".