4 ms·
Confabulation is the accurate psychological term. Hallucination is a perceptual issue. The LLM term is misleading.
by goatlover 2y ago
Confabulation is the accurate psychological term. Hallucination is a perceptual issue. The LLM term is misleading.
- moffkalast 2y agoConfabulation would be actual false memories no? I suppose some of it are consistent false beliefs, but more often than not it's well.. lapsus. One token gets generated wrong, or the sampler picks something mindbogglingly dumb that doesn't make any sense because of high temperature, and the model can't help but try and continue as confidently as it can, pretending everything is fine without any option to correct itself. Some thinking models can figure these sort of mistakes out in the long run but it's still not all that reliable and requires training it that way from the base model. Confident bullshitting seems to be very ingrained in current instruct datasets.