2 ms·

Part of the problem is over-personification of these models. "Hallucination" as an industry term implies that the model is a thinking entity with a perception t

Part of the problem is over-personification of these models. "Hallucination" as an industry term implies that the model is a thinking entity with a perception that is faulty. Instead, it's more like a slow database that has failed to provide correct information. If you'd like a LLM to provide a stream of characters that look like text, they're very good for that. They're not good for providing information, full stop.

exe34 2y ago
I think hallucination is just a euphemism for bullshitting. people do it too, I've met plenty of people who can talk confidently about things they clearly don't understand.
- kemotep 2y ago
  The issue here is that someone who forgets the concert is already over vs a search engine tells me the wrong dates for a concert is that, I expect the computer to provide accurate information. This wasn’t an issue 10 years ago. Google a festival or event, get a website or article about it, they provide the dates. This is like your local newspaper giving the wrong movie times or incorrect scores from the big game. People make mistakes but people’s whose job it is to provide information about something and who are unable to reliably provide that information tend to lose their jobs. Why should I “hire” OpenAI’s solution if it fails to be even as reliable as a human?
  - exe34 2y ago
    It's beautiful isn't it? We had cases before of say mortgage advisors refusing you service based on this "score" that they won't tell you how they compute, despite your good history of managing money competently and being able to afford it. Now you don't just have a computer that says no, you also have one that will randomly tell you things that aren't true.
- Bluestein 2y ago
  Confabulation would - by some - be more fitting a term - at least as per an analogy describing to goings on vis-à-vis a human mind.-
- shmeeed 2y ago
  It's just that with people you don't expect them to update every few months with a new and improved version of themselves that supposedly bullshits less. Instead at some point you just stop asking, or at least don't take them seriously any more.
  - exe34 2y ago
    nah usually I hope they get promoted away so I don't have to see them again.

exe34 2y ago

I think hallucination is just a euphemism for bullshitting. people do it too, I've met plenty of people who can talk confidently about things they clearly don't understand.

kemotep 2y ago
The issue here is that someone who forgets the concert is already over vs a search engine tells me the wrong dates for a concert is that, I expect the computer to provide accurate information. This wasn’t an issue 10 years ago. Google a festival or event, get a website or article about it, they provide the dates. This is like your local newspaper giving the wrong movie times or incorrect scores from the big game. People make mistakes but people’s whose job it is to provide information about something and who are unable to reliably provide that information tend to lose their jobs. Why should I “hire” OpenAI’s solution if it fails to be even as reliable as a human?
- exe34 2y ago
  It's beautiful isn't it? We had cases before of say mortgage advisors refusing you service based on this "score" that they won't tell you how they compute, despite your good history of managing money competently and being able to afford it. Now you don't just have a computer that says no, you also have one that will randomly tell you things that aren't true.
Bluestein 2y ago
Confabulation would - by some - be more fitting a term - at least as per an analogy describing to goings on vis-à-vis a human mind.-
shmeeed 2y ago
It's just that with people you don't expect them to update every few months with a new and improved version of themselves that supposedly bullshits less. Instead at some point you just stop asking, or at least don't take them seriously any more.
- exe34 2y ago
  nah usually I hope they get promoted away so I don't have to see them again.