3 ms·

The paper states that hallucinations are logical reasoning errors... that confused me. For me a hallucination is the conjuring up of facts, things, references,

by golol 3y ago

The paper states that hallucinations are logical reasoning errors... that confused me. For me a hallucination is the conjuring up of facts, things, references, characters etc. as is convenient for the given context.

BeetleB 3y ago
Semantics aside: I once gave it a math problem, and its hallucinations really did present as logical errors. I was a TA for several years, and it was reminiscent of the mistakes students make. Something that sounds fairly plausible, but still incorrect, with logical errors or unjustified steps.
sebzim4500 3y ago
It's really hard to formally define hallucination, for me it's a "know it when you see it" situation. In my view, saying "10 + 4 = 15" is not a hallucination but inventing a citation that doesn't exist is one. There is a big grey area between these, like what if it cites a real paper but gets the year wrong? Is that a hallucination (because the paper as cited is fake), or just an incorrect statement (because the year is just wrong)?
DiscourseFan 3y ago
The trouble (probably not for basic math or even low-level analysis) is that what we refer to as "logic" or a logical reasoning error isn't uniform across different axiomatic systems, and the specific interpretations is a fairly human, social activity which cannot be readily "checked" in many cases for correctness against some baseline notion of "logic". The symbol φ, for instance, has a variety of significations in different context (the family of sets of all functions, probably something in physics idk), which our interpreto-bot (GPT) might not be able to both logically integrate and loosely interpret at the same time. Humans have the capacity to apprehend both consistent and complete logical systems: they interpret at the level of the text (at the level of the weave of signification), and any generally intelligent AI would have to mimic that behavior of the constant, on-the-fly dynamic changes to its network at the appearance of every new signifier in the same way as a human does.

by golol 3y ago

BeetleB 3y ago

Semantics aside: I once gave it a math problem, and its hallucinations really did present as logical errors. I was a TA for several years, and it was reminiscent of the mistakes students make. Something that sounds fairly plausible, but still incorrect, with logical errors or unjustified steps.

sebzim4500 3y ago

It's really hard to formally define hallucination, for me it's a "know it when you see it" situation. In my view, saying "10 + 4 = 15" is not a hallucination but inventing a citation that doesn't exist is one. There is a big grey area between these, like what if it cites a real paper but gets the year wrong? Is that a hallucination (because the paper as cited is fake), or just an incorrect statement (because the year is just wrong)?

DiscourseFan 3y ago

The trouble (probably not for basic math or even low-level analysis) is that what we refer to as "logic" or a logical reasoning error isn't uniform across different axiomatic systems, and the specific interpretations is a fairly human, social activity which cannot be readily "checked" in many cases for correctness against some baseline notion of "logic". The symbol φ, for instance, has a variety of significations in different context (the family of sets of all functions, probably something in physics idk), which our interpreto-bot (GPT) might not be able to both logically integrate and loosely interpret at the same time. Humans have the capacity to apprehend both consistent and complete logical systems: they interpret at the level of the text (at the level of the weave of signification), and any generally intelligent AI would have to mimic that behavior of the constant, on-the-fly dynamic changes to its network at the appearance of every new signifier in the same way as a human does.