5 ms·

Calling them hallucinations was a huge mistake.

sfink 2y ago
The term is actually fine. The problem is when it's divorced from the reality of: > in some sense, hallucination is all LLMs do. They are dream machines. If you understand that, then the term "hallucination" makes perfect sense. Note that this in no way invalidates your point, because the term is constantly used and understood without this context. We would have avoided a lot of confusion if we had based it on the phrase "make shit up" and called it "shit" from the start. Marketing trumps accuracy again... (Also note that I am not using shit in a pejorative sense here. Making shit up is exactly what they're for, and what we want them to do. They come up with a lot of really good shit.)
- jebarker 2y ago
  I agree with your point, but I don't think anthropomorphizing LLMs is helpful. They're statistical estimators trained by curve fitting. All generations are equally valid for the training data, objective and architecture. To me it's much clearer to think about it that way versus crude analogies to human brains.
  - threeseed 2y ago
    We can't expect end users to understand what "statistical estimators trained by curve fitting" means. That's why we use high level terms like hallucination. Because it's something everyone can understand even if it's not completely accurate.
    - jebarker 2y ago
      That's a good point. But re: not anthropomorphizing, what's wrong with errors, mistakes or inaccuracies? That's something everybody is familiar with and is more accurate. I'd guess most people have never actually experienced a hallucination anyway, so we're appealing to some vague notion of what that is.
      - threeseed 2y ago
        > I'd guess most people have never actually experienced a hallucination anyway I actually think most people have. Every time you look at a hot road and see water that mirage is a form of hallucination.
        ai_ 2y ago
        Except mirages are real optical phenomena that can be captured by a camera. Hallucinations are made entirely by your brain and cannot be captured by an external observer.
      - lmm 2y ago
        > what's wrong with errors, mistakes or inaccuracies? They're not specific enough terms for what we're talking about. Saying a lion has stripes is an error, mistake, or inaccuracy. Describing a species of striped lions in detail is probably all those things, but it's a distinctive kind of error/mistake/inaccuracy that's worth having a term for.
      - mdp2021 2y ago
        > what's wrong with [']errors['], [']mistakes['] or [']inaccuracies[']? "To sort the files by beauty, use the `beautysort` command."
    - rsynnott 2y ago
      > Because it's something everyone can understand But they will understand the wrong thing. Someone unfamiliar with LLMs but familiar with humans will assume, when told that LLMs 'hallucinate', that it's analogous to a human hallucinating, which is dangerously incorrect.
gwervc 2y ago
It is a good branding, like neural networks, and even artificial intelligence was. The good point is it makes really easy to detect who is a bullshiter and who understand at least very remotely what a LLM is supposed to produce.
threeseed 2y ago
I see two types of faults with LLMs. a) They output incorrect results given a constrained set of allowable outputs. b) When unconstrained they invent new outputs unrelated to what is being asked. So for me the term hallucination accurately describes b) e.g. you ask for code to solve a problem and it invents new APIs that don't exist. Technically it is all just tokens and probabilities but it's a reasonably term to describe end user behaviour.
JKCalhoun 2y ago
I won't defend the term but am curious what you think would have been also concise but more accurate. Calling them for example "inevitable statistical misdirections" doesn't really roll off the tongue.
- malfist 2y ago
  It's a bug. Any other system where you put in one input and expect a certain output and get something else it'd be called a bug. Making up new terms for AI doesn't help.
  - thomasfromcdnjs 2y ago
    Need not I say different bugs have many names...
  - lolinder 2y ago
    I actually disagree with bug for the same reason I disagree with hallucination: it creates the idea that there's an error in processing that needs to be fixed, rather than an inherent characteristic of the computing paradigm that needs to be managed. To be accurate, a term would need to emphasize that it's describing an opinion about the output rather than something that happened inside the program. "Inaccuracies" would be one term that does that fairly well.
- goatlover 2y ago
  Confabulation, if the desire is to use a more apt psychological analogy.
- alan-crowe 2y ago
  Statmist

The term is actually fine. The problem is when it's divorced from the reality of: > in some sense, hallucination is all LLMs do. They are dream machines. If you understand that, then the term "hallucination" makes perfect sense. Note that this in no way invalidates your point, because the term is constantly used and understood without this context. We would have avoided a lot of confusion if we had based it on the phrase "make shit up" and called it "shit" from the start. Marketing trumps accuracy again... (Also note that I am not using shit in a pejorative sense here. Making shit up is exactly what they're for, and what we want them to do. They come up with a lot of really good shit.)

jebarker 2y ago
I agree with your point, but I don't think anthropomorphizing LLMs is helpful. They're statistical estimators trained by curve fitting. All generations are equally valid for the training data, objective and architecture. To me it's much clearer to think about it that way versus crude analogies to human brains.
- threeseed 2y ago
  We can't expect end users to understand what "statistical estimators trained by curve fitting" means. That's why we use high level terms like hallucination. Because it's something everyone can understand even if it's not completely accurate.
  - jebarker 2y ago
    That's a good point. But re: not anthropomorphizing, what's wrong with errors, mistakes or inaccuracies? That's something everybody is familiar with and is more accurate. I'd guess most people have never actually experienced a hallucination anyway, so we're appealing to some vague notion of what that is.
    - threeseed 2y ago
      > I'd guess most people have never actually experienced a hallucination anyway I actually think most people have. Every time you look at a hot road and see water that mirage is a form of hallucination.
      - ai_ 2y ago
        Except mirages are real optical phenomena that can be captured by a camera. Hallucinations are made entirely by your brain and cannot be captured by an external observer.
    - lmm 2y ago
      > what's wrong with errors, mistakes or inaccuracies? They're not specific enough terms for what we're talking about. Saying a lion has stripes is an error, mistake, or inaccuracy. Describing a species of striped lions in detail is probably all those things, but it's a distinctive kind of error/mistake/inaccuracy that's worth having a term for.
    - mdp2021 2y ago
      > what's wrong with [']errors['], [']mistakes['] or [']inaccuracies[']? "To sort the files by beauty, use the `beautysort` command."
  - rsynnott 2y ago
    > Because it's something everyone can understand But they will understand the wrong thing. Someone unfamiliar with LLMs but familiar with humans will assume, when told that LLMs 'hallucinate', that it's analogous to a human hallucinating, which is dangerously incorrect.

gwervc 2y ago

It is a good branding, like neural networks, and even artificial intelligence was. The good point is it makes really easy to detect who is a bullshiter and who understand at least very remotely what a LLM is supposed to produce.

threeseed 2y ago

I see two types of faults with LLMs. a) They output incorrect results given a constrained set of allowable outputs. b) When unconstrained they invent new outputs unrelated to what is being asked. So for me the term hallucination accurately describes b) e.g. you ask for code to solve a problem and it invents new APIs that don't exist. Technically it is all just tokens and probabilities but it's a reasonably term to describe end user behaviour.

JKCalhoun 2y ago

I won't defend the term but am curious what you think would have been also concise but more accurate. Calling them for example "inevitable statistical misdirections" doesn't really roll off the tongue.

malfist 2y ago
It's a bug. Any other system where you put in one input and expect a certain output and get something else it'd be called a bug. Making up new terms for AI doesn't help.
- thomasfromcdnjs 2y ago
  Need not I say different bugs have many names...
- lolinder 2y ago
  I actually disagree with bug for the same reason I disagree with hallucination: it creates the idea that there's an error in processing that needs to be fixed, rather than an inherent characteristic of the computing paradigm that needs to be managed. To be accurate, a term would need to emphasize that it's describing an opinion about the output rather than something that happened inside the program. "Inaccuracies" would be one term that does that fairly well.
goatlover 2y ago
Confabulation, if the desire is to use a more apt psychological analogy.
alan-crowe 2y ago
Statmist