4 ms·
It is not a good start that they begin with a dictionary definition of Hallucinations. While the similarities to what a LLM does are apparent enough for the ter
by Lerc 3y ago
It is not a good start that they begin with a dictionary definition of Hallucinations. While the similarities to what a LLM does are apparent enough for the term to be used, LLMs are under no obligation to behave similar to the dictionary definition of Hallucinations.
In general facts are not the answer to Hallucinations. You can't possibly have every fact for every situation. The true solution to Hallucinations is figuring out how to make a model say 'I don't know"
- ddmma 3y agoYou cannot fix what you cannot measure, here is an attempt to do just that with HallMeter https://why.network/ https://why.network/ Still have to figure a measurement unit.
- anon25783 3y agoHow about "falsehood quotient"? Count the number of counterfactual assertions in a given text, then divide by the number of sentences. Of course, the question of what is a falsehood is an exercise for the reader, but this would at least give a unit of measurement, flawed as it is.
- janalsncm 3y agoThe “exercise for the reader” in this case is the entire point of the metric. If it were possible to do at scale it could be incorporated into existing models right now. Second, it isn’t even necessarily better to have fewer lies if those few lies are more subtle. Plenty of propaganda works by twisting facts and using misleading statements. Perhaps the worst offenders won’t even have any outright falsehoods at all.
- ddmma 3y agothat is very interesting input, thanks! Also split into sentences, similar to what sentiment analytics does would raise the level of complexity into the output metric.
- lqhl 3y agoThis article suggests that LLMs should use a database as a reference for factual information. Rather than asking LLMs to provide their own answers, it is recommended that they summarize based on the facts extracted from the database. This approach reduces the likelihood of hallucinations among LLMs.
- teej 3y ago> This approach reduces the likelihood of hallucinations among LLMs. This has not been my experience. Did you create any benchmarks as a part of this project?
- mpsk 3y agoI am the author of this article. And actually what we tried to do was to replicate the simplest implementation to Retrieval Augmented Language Models by prompting the LLM. There have been many researches on this topic right now like work from Meta(https://arxiv.org/pdf/2208.03299v3.pdf https://arxiv.org/pdf/2208.03299v3.pdf). I think it can give you a picture how those RALMs boost the performance on General QA tasks.
- lqhl 3y agoThis idea is a simplified version of Retrieval-Augmented Generation (RAG), and RAG has been studied in various research papers, such as the one available at https://arxiv.org/abs/2005.11401 https://arxiv.org/abs/2005.11401
- npsomaratna 3y agoMy experience with RAG is that while it reduces the incidence of hallucinations* significantly (especially if you reduce the LLM temperature to zero at the same time), it doesn't eliminate them. My startup has a product for lawyers that uses RAG to answer legal queries (https://lawlight.ai/ https://lawlight.ai/). We have a disclaimer that "... (we) do not guarantee the accuracy of answers. You are responsible for reviewing the cited case law and drawing your own independent conclusions." (This works within the specific context—lawyers are domain experts; and they are supposed to read through all cases they cite in court anyway.) * I dislike the term "hallucinations." By definition LLMs hallucinate. It's just that much (or most) of the time, the hallucinations reflect reality.
- s1mon 3y ago"Hallucination" makes it sound like ChatGPT drank some of the punch without realizing it was laced with LSD. "Bullshit" sounds more like what comes out of an overconfident ass who should or could know better with some better education.
- delecti 3y agoHallucination is a better descriptor for what an LLM is doing though. A bullshitter knows they don't know, an LLM just strings words together in ways that fit what it "saw" from training data. IMO the main problem with calling them hallucinations is the implication that the true things they say are true on purpose. It's hallucinating the true things too.
- mdp2021 3y agoExactly, but no, there should be no «implication that the true things they» output are not part of that: required modules for foundational thinking (let us say "critical thinking") are missing. (Issue is, now some are convinced that people in general would do the same and just blurt out the feedforward output of their "internal neural network", as opposed to having built knowledge in a loop of critical evaluation.)
- ImHereToVote 3y agoIn Swedish the term for perception and misapprehension is the same word. Because it is the same thing.
- rsynnott 3y ago_Both_ are an inappropriate degree of anthropomorphism IMO.
- balnaphone 3y ago"Confabulation" is the correct and precise term that comports with the English language, rather than being jargon requiring a neologism.
- 3y ago