4 ms·
As anthropomorphic as calling hallucinations to inaccuracies of the model. I feel anthropomorphism is part of the marketing strategy for LLMs
by melenaboija 2y ago
As anthropomorphic as calling hallucinations to inaccuracies of the model.
I feel anthropomorphism is part of the marketing strategy for LLMs
- jazzyjackson 2y agoHaving an oracle to chat with is a good product, but a bad framing for the tech. IMO all the broken expectations come from viewing the output as something that comes from "an other", a thing other than yourself with knowledge and experience, when really it's more of a mirror, reflecting your words back to you, enlarged or squeezed like funhouse mirrors (back in my day we didn't have skinny filters, we had to walk uphill to the pier and stand in front of a distorted piece of mercury glass! ;).
- MobiusHorizons 2y agoDid you live under water? How was the pier uphill;)
- cpeterso 2y agoThe inland area could be lower than the waterfront.
- jazzyjackson 2y agoSomehow I just knew a few of you'se would consider the implications of walking uphill to a pier
- botanical76 2y agoWhat other word would you suggest? I've seen "bullshitting" suggested, but this of course still implies intent, which AIs do not have in any typical sense of the word. I think we as a community have settled on hallucination as the best English word that approximately conveys the idea. I've seen folks on here making up words to describe it, as if that is any more useful to the victim here. The victim being the uninformed (w.r.t AI tech) layperson.
- codetrotter 2y ago“Confabulations” is sometimes mentioned as an alternative to “hallucinations”. It’s a better alternative than “bullshitting”, because “confabulating” does not have that kind of connotation of intent.
- atoav 2y agoLLMs give you a plausible chain of words, the word "hallucination" assumes intentionality that doesn't exist — as if the LLM had a "clear" state of mind and one where it felt a bit dizzy — but all of that does not describe what is going on.
- CooCooCaCha 2y agoHallucination does not imply intentionality, in fact the opposite.
- atoav 2y agowhich was my point.
- CooCooCaCha 2y agoYour point is misusing a word? The word “hallucination” in no way implies intentionality.
- atoav 2y agoGranted maybe it was a bit unclear, so let me claify my point: In humans hallucination is about a loss of a relationship with an underlying physical world. A physical world whose model we have in our heads and interact with in intentional ways if we are not hallucinating. That means using the word hallucinating implies that the thing could also not be hallucinating and have a grip on reality. And rhis was my criticism, a LLM spits out plausible phrases, if the graph wouldn't consider an output plausible it wouldn't return it. That means for the LLM there is no difference between plausible bogus and a factually correct statement, this is something humans interpret into the output from the outside.
- stavros 2y agoA more apt word is "confabulation".