3 ms·
It's just a word meaning AI gives wrong answer. No, it’s more specific than just wrong. Hallucination is when a model creates a bit of fictitious knowledge, a
by p1esk 2y ago
It's just a word meaning AI gives wrong answer.
No, it’s more specific than just wrong.
Hallucination is when a model creates a bit of fictitious knowledge, and uses that knowledge to answer a question.
- olalonde 2y agoCan you give an example of a "wrong" answer vs an "hallucinated" answer?
- omikun 2y agoThe issue is there is no difference between a right answer and a hallucinated answer.
- stefanve 2y agothere are many types of a wrong answer, and the difference is based on how the answer came to be. In case of BS/Hallucination there is no reason or logic behind the answer it is basically, in the case of LLM, just random text. There was no reasoning behind the output or it wasn't based on facts. You can argue if it matters how a wrong answer came about ofc but there is a difference
- influx 2y agoWrong is code that doesn’t compile. Hallucinated is compilable code using a library that never existed.
- ruszki 2y agoIt doesn't need to create wrong answers. It's enough to recall people who gave wrong answers.
- ben_w 2y agoI've heard the term originated in image recognition, where models would "see" things that weren't there. You can still get that with zero bad labels in a supervised training set. Multiple causes for the same behaviour makes progress easier, but knowing if it's fully solved harder.