3 ms·
I couldn't agree more. Words matter and this is a complete mismatch between concepts. > HALLUCINATION: a sensory perception (such as a visual image or a sound)
by Nevermark 3y ago
I couldn't agree more. Words matter and this is a complete mismatch between concepts.
> HALLUCINATION: a sensory perception (such as a visual image or a sound) that occurs in the absence of an actual external stimulus and usually arises from neurological disturbance [...] [0]
When we let a model run free, without input, or with random input, whatever the model imagined it was experiencing (i.e. its internal representation) would be an hallucination.
> CONFABULATION: to fill in gaps in memory by fabrication
This is exactly the right concept (and therefore word) for what is happening.
[0] https://www.merriam-webster.com/dictionary/hallucination https://www.merriam-webster.com/dictionary/hallucination
[1] https://www.merriam-webster.com/dictionary/confabulation https://www.merriam-webster.com/dictionary/confabulation
- galaxyLogic 3y agoGood point. "Hallucination" is about incorrectly perceived input, not incorrect output. When people hallucinate they don't usually react to it verbally at all, they just observe it. Not the case with LLMs. They just keep on saying something, because they are designed to produce answers.