2 ms·
It doesn't. Hallucination in this context means 'an unfounded or mistaken impression or notion'. There's one side of the current zeitgeist that over-anthropomo
by BoorishBears 3y ago
It doesn't. Hallucination in this context means 'an unfounded or mistaken impression or notion'.
There's one side of the current zeitgeist that over-anthropomorphizes these models. But there's another side that seems to be terrified that LLMs could be anything resembling intelligent
Both sides are pretty emotion over facts though. A lot of their "human-like" behavior is emergent from things that don't work the same way in a humans... but we also don't understand cognition enough to then say there's no overlap between what LLMs are doing and what some part of our own thought process is like. If anything we have more studies that imply the opposite going back decades: https://www.sciencedirect.com/science/article/abs/pii/S0926641097000335 https://www.sciencedirect.com/science/article/abs/pii/S09266...
- JohnFen 3y ago> It doesn't. Hallucination in this context means 'an unfounded or mistaken impression or notion'. Correct. Which, as near as I can tell, isn't the correct characterization of what's happening with LLMs. > But there's another side that seems to be terrified that LLMs could be anything resembling intelligent I certainly have no such fear. I say that only to indicate that my biases are not of that sort.
- BoorishBears 3y agoThe first sentence seems contradicted by the second no? If you don't have that fear then why bother playing around the semantics of "impression or notion"? Is it an unfounded or mistaken cluster of tokens which resemble an impression or notion then? At the end of the day it's producing an output which systemically was intended to be accurate, but ended up not being accurate through a mistake in generation: That's a hallucination.