3 ms·
All responses are hallucinations; some of them are close enough to what we want to be useful, others not so much.
by asadotzler 2y ago
All responses are hallucinations; some of them are close enough to what we want to be useful, others not so much.
- deleted 2y ago[deleted]
- tripplyons 2y agoCorrect responses wouldn't be considered hallucinations.
- CharlesW 2y agoNot by the human evaluator, assuming they know (or otherwise validate) that the generated output is correct. But an LLM alone doesn't differentiate between hallucinations and not-hallucinations.
- Terr_ 2y ago... But they ought to be considered hallucinations, it's the same algorithm at work, we just are biased in favor of certain results. Similarly, suppose I always roll dice to determine tomorrow's winning lottery-ticket number. Getting it right one day doesn't change the mechanism I used. Some people might assume I was psychic, but would be wrong.
- Matthyze 2y agoYou're absolutely correct and it's ridiculous that HN can't fathom that a hallucination, in both the traditional and LLM sense, is not characterized by its form or content per se but by the fact that the form or content is incongruent with some external factor.
- esafak 2y agoWould you say the same of humans?
- doug_durham 2y agoI would absolutely say the exact same thing about humans. Except that humans know less. We also have a sense of uncertainty which is absent in LLMs.
- skydhash 2y agoWe have the same generative ability, but we gradually learn the correct answers (not necessarily truths), so we don't go around generating incorrect ones (not necessarily falsehoods). Then we know when we don't have any answers, so generating one is fruitless. LLMs is just generation. Whatever pattern they embedded, they will happily extrapolate and add wrong information than just use it as a meta model.
- munchler 2y agoThat is a good question. I think the biggest difference is that humans have access to sensory data that grounds us in reality. If you put a human in complete sensory deprivation, I think we would hallucinate much more.
- eric_h 2y agoindeed, isn't hallucination one of the purported intended effects of a sensory deprivation tank?