3 ms·

> which I'd rather simply call what it is, which is lying I like the term "bullshitting" as it implies it acts like it knows, but doesn't. I can't stand it wh

> which I'd rather simply call what it is, which is lying I like the term "bullshitting" as it implies it acts like it knows, but doesn't. I can't stand it when they call it "hallucinating", as it instead might imply the problem is with the interpretation of the sensory input. This term might be more appropriate to describe adversarial attacks executed through information input.

shanebellone 3y ago
"which I'd rather simply call what it is, which is lying" "I like the term "bullshitting" as it implies it acts like it knows, but doesn't." It's not "lying" or "bullshitting". It's working as designed. It's not a repository of truth; just long-form autofill.
- HybridCurve 3y ago
  It's not being sold as long-form autofill. It's being sold as something which will respond to queries, and there is an expectation that the information it replies with should have some accuracy. I am not in disagreement with your generalization of how it functions or that it lacks empirical knowledge. Some responses are accurate, some are not. It will always give a response but does not always produce a disclaimer saying that the response might have been inaccurate. So, in criticism of the existing nomenclature used to describe this phenomena (hallucination), I simply suggested something more appropriate.
  - shanebellone 3y ago
    I agree that it's being positioned deceptively. Today, it is just a novelty.
kaycey2022 3y ago
I think “malfunctioning” is the correct term you are looking for. Lying and Bullshitting and Hallucinating anthropomorphises the software. It is simply not functioning as advertised (not intended).
- danaris 3y ago
  "Malfunctioning" isn't really accurate, either—because the common usage of that term isn't "not functioning as advertised", not in this world where salespeople will say literally anything to get someone to buy their product. It's "not functioning as designed". "Hallucinations" are 100% an LLM functioning as designed. They are every bit as valid as any other output. LLMs have no concept of truth, no model of the world, no way even in theory to determine the validity of any particular statement they output. The problem isn't the term "hallucinations", so much as it is the idea that anything they produce is not a hallucination.

shanebellone 3y ago

"which I'd rather simply call what it is, which is lying" "I like the term "bullshitting" as it implies it acts like it knows, but doesn't." It's not "lying" or "bullshitting". It's working as designed. It's not a repository of truth; just long-form autofill.

HybridCurve 3y ago
It's not being sold as long-form autofill. It's being sold as something which will respond to queries, and there is an expectation that the information it replies with should have some accuracy. I am not in disagreement with your generalization of how it functions or that it lacks empirical knowledge. Some responses are accurate, some are not. It will always give a response but does not always produce a disclaimer saying that the response might have been inaccurate. So, in criticism of the existing nomenclature used to describe this phenomena (hallucination), I simply suggested something more appropriate.
- shanebellone 3y ago
  I agree that it's being positioned deceptively. Today, it is just a novelty.

kaycey2022 3y ago

I think “malfunctioning” is the correct term you are looking for. Lying and Bullshitting and Hallucinating anthropomorphises the software. It is simply not functioning as advertised (not intended).

danaris 3y ago
"Malfunctioning" isn't really accurate, either—because the common usage of that term isn't "not functioning as advertised", not in this world where salespeople will say literally anything to get someone to buy their product. It's "not functioning as designed". "Hallucinations" are 100% an LLM functioning as designed. They are every bit as valid as any other output. LLMs have no concept of truth, no model of the world, no way even in theory to determine the validity of any particular statement they output. The problem isn't the term "hallucinations", so much as it is the idea that anything they produce is not a hallucination.