3 ms·
These seem very distinct from the non-existent URL or citation kind of “hallucination”. The academic community should come up with better terminology.
by williamcotton 3y ago
These seem very distinct from the non-existent URL or citation kind of “hallucination”.
The academic community should come up with better terminology.
- JohnFen 3y agoI also think "hallucination" is generally an actively terrible term for AI output that isn't factually correct. It's misleading, at the very least.
- williamcotton 3y agoI agree and unfortunately I didn’t construct my original comment in a manner that makes that agreement clear!
- burnte 3y agoI think it's incredibly accurate. Humans can misinterpret some internal inputs as external inputs and we hallucinate. This is doing the same, erroneous interpretation leading to nonsense interactions.
- JohnFen 3y agoI don't think that's an accurate description of these errors at all, honestly. It's not a matter of ChatGPT "interpreting" anything. It's a matter of it assembling a response that is linguistically most likely, given its training. That's categorically different than hallucination, which is an active misinterpretation/invention of sensory data.
- digging 3y agoIt "sees" something it "believes" is true, how is hallucination not an accurate term?
- JohnFen 3y agoBecause it's neither "seeing" anything, nor is it "believing" anything. In fact, I think it's incorrect to even call such responses "wrong". ChatGPT successfully put together a reasonable-sounding response to the prompt, which is exactly what it is designed to do.
- williamcotton 3y agoYou're correct. For the downvoters, here is the explanation: You know how sometimes an LLM completes a given text in a way that you would consider "wrong"? Well, the LLM has no concept of "correct" or "wrong". It just has a very broad and deep model of the entirety of the text in the training data. Sometimes you might consider the completion "correct". Sometimes you might consider the completion "wrong". Sometimes I may consider the completion "correct" and you may consider the completion "wrong", just as with many other kinds of statements. The logical reasoning happens outside of the statement itself and can reasonably have many interpretations. Would you ever consider that a plant has grown in a way that is "wrong"? Or that a broken reciprocating saw cut through plywood in the "wrong" way?
- digging 3y agoWell, feel free to make up a new word then and see if it catches on. I will keep calling it hallucination because that effortlessly describes what is happening through analogy, a powerful tool by which we can make difficult concepts more accessible. I hope you realize that my use of quotes is another common literary tool which indicated I know a LLM can't actually see.
- deleted 3y ago[deleted]
- pegasus 3y agoAgreed. I find "confabulating" more appropriate.
- redox99 3y agoWait till you hear about test and validation set.
- baking 3y agoThese are "glitch tokens" and well known.