3 ms·
"Hallucinating" is really a euphemism for fluent bullshitting. It also doesn't fit the normal understanding of a hallucination. It's just wrong information expr
by Zigurd 3y ago
"Hallucinating" is really a euphemism for fluent bullshitting. It also doesn't fit the normal understanding of a hallucination. It's just wrong information expressed confidently. Partly it's how the conversational UI works, and partly how the model works. Without the nice generated text that creates in our minds an impression of competence, it would just be an error.
- Grimblewald 3y agobullshitting implies internal knowledge of the deceit, if this were the case we could just train models to not bullshit and tell only the truth. A hallucination, when things are hallucinations, is when the model 'believes' what it is predicting to be equivalent to truth.