5 ms·
Perhaps not useful to the conversation, but I really wish that whomever coined the behavior as a 'hallucination' had consulted a dictionary first. It's delusio
by chrsig 3y ago
Perhaps not useful to the conversation, but I really wish that whomever coined the behavior as a 'hallucination' had consulted a dictionary first.
It's delusional, not hallucinated.
Delusions are the irrational holdings of false belief, especially after contrary evidence has been provided.
Hallucinations are false sensations or perceptions of things that do not exist.
May some influential ML person read this and start to correct the vocabulary in the field :)
- giantrobot 3y agoI prefer the term confabulation. To the AI the made up thing isn't necessarily irrational. It's in fact very rational, simply incorrect.
- asadotzler 3y agoaka bullshit. it is a bullshitter or a bullshit artist, virtually synonymous with confabulator.
- 65a 3y agoConfabulation seems better aligned to neuropsychology, as far as I can tell: https://en.wikipedia.org/wiki/Confabulation https://en.wikipedia.org/wiki/Confabulation
- garba_dlm 3y agocool, the scientific name for studying gaslighting!
- groby_b 3y agoGaslighting and confabulation are very different things. Gaslighting are deliberate lies with the intent of creating self-doubt in the targeted person. Confabulation is creating falsehoods without an intent to deceive. When we're discussing naming, it might be a good idea not to throw more misleading names onto the bonfire.
- garba_dlm 3y agomy point is they're related. but i didn't explain why and you're mistaken on the intent of gaslighting. it's intended to control 'confabulation' reflects on how that's sort of control is even possible
- lazide 3y agoGaslighting is also usually associated with disorders involving strong delusional behavior. Delusions are maladaptive protective behavior (a false worldview that avoids actual ‘dangerous’ thoughts or information), and when challenged in a threatening way, particularly dangerous folks often gaslight the threat. It’s easy and natural for them to do, because they already have all the tools necessary to maintain the original delusion. It’s the ‘my world view will be unchallenged or I will destroy yours’ reaction. NPD being a very common example. Certainly not the only one though!
- nikanj 3y agoThat one is not part of everyone’s vocabulary
- baq 3y agoNot too late still, though an uphill battle
- deleted 3y ago[deleted]
- inopinatus 3y agoIf we’re going to play this game then my imaginary friend Apophenia wants to join in.
- oxygen_crisis 3y agoThat's even better, then, to address the issue of laypeople misinterpreting a distinctive problem according to familiar, overloaded definitions of the word used to refer to it.
- Brian_K_White 3y agoThe llm has neither of these, so neither is more correct or incorrect than the other.
- SkyPuncher 3y agoI think it’s appropriate. Delusion tends to describe a state of being, in the form of delusional. Hallucinations tend to be used to describe an instance or finite event. Broadly, LLMs are not delusions, but they do perceive false information.
- user_7832 3y agoI propose using delirium/delirious to describe the software.
- deleted 3y ago[deleted]
- inopinatus 3y agoLLMs don’t hold beliefs. Believing otherwise is itself a delusion. In addition, the headline posted here doesn’t even say hallucinated, so that is also an hallucination. It says hallucineted. As portmanteaux go, that ain’t bad. I rather like the sense of referring to LLMs as hallucinets.
- bregma 3y agoI think the right word is "bullshit". LLMs are neither delusional nor hallucinating since they have no beliefs or sensory input. The just generate loads of fertilizer and a lot of people like to spread it around.
- asadotzler 3y agoThis is the correct answer. It's not a hallucination. It's goal is to create something that seems like the truth despite the fact that it has no idea if it's actually being truthful. If a human were doing this we'd call them a bullshitter or of they were good at it, maybe even a bullshit artist.
- wlonkly 3y agoI've been calling it bullshit too, because the thing about bullshitting is that the truth is irrelevant to a good story.
- jazzyjackson 3y agoIMHO it's fine to have a certain jargon within the context of "things neural nets do" and comes from the days of Deep Dream, when image classifiers were run in reverse and introduced the public to computer-generated-images that were quite psychedelic in nature. It's seeing things that aren't there.
- dylan604 3y agoThe phrase "you must be trippin'!" is commonly used by some when they say something completely nonsensical. I can easily see where how/why hallucinating was chosen. It's clearly meant to poke fun of the system. If you think people are going to NOT use words in jest while making fun of something, perhaps you could use a little less starch in your clothing.
- SrslyJosh 3y agoLLMs do not have beliefs, so "delusion" is no better than "hallucination". As statistical models of texts, LLMs do not deal in facts, beliefs, logic, etc., so anthropomorphizing them is counter-productive. An LLM is doing the exact same thing when it generates "correct" text that it's doing when it generates "incorrect" text: repeatedly choosing the most likely next token based on a sequence of input and the weights it learned from training data. The meaning of the tokens is irrelevant to the process. This is why you cannot trust LLM output.