3 ms·
Is retrieval necessary/sufficient to solve “hallucinations”?
Hi everyone,
"Hallucinations" seem to be one of the major blockers to the adoption of LLMs, especially in enterprise settings where seemingly plausible but false information/decisions can be disastrous.
I am wondering whether or not current LLMs, like GPT4 or Llama 2 70b have reached the reasoning capabilities to be able not to hallucinate when fed the proper information.
One can see a LLMs as college / high school students that have some basic reasoning and knowledge but might need to be nudged to answer business / scientific questions.
What is your opinion on the topic? Is there for instance, a database of hallucinations, so that one could test that if the model would have answered properly if the right context was fed in the prompt?
- PaulHoule 3y agoThe other day I made an incorrect statement about who played in the Superbowl in 1984, it turned up the game I was thinking of was the 1986 Superbowl and somebody corrected me. Would you call that a “hallucination” or just not remembering right? If I were going to get perfect accuracy for something I write I’d have to look everything up and I could prove it was the sources that were wrong and not me if I cited them. Would an A.I. really be any different?