4 ms·
And if that confidence level is high enough for it to output an answer, but that answer is wrong or nonsensical, what do we call it?
by lewispollard 2y ago
And if that confidence level is high enough for it to output an answer, but that answer is wrong or nonsensical, what do we call it?
- ben_w 2y agoIn humans? Overconfidence.
- kolinko 2y agoLLMs have no idea if they hallucinate ≠ LLM make no mistakes. The former statement is a bold claim that would require some sort of evidence. The latter nobody really argues with.
- lewispollard 2y ago"Hallucinate" is just a term we've come up with for LLMs making mistakes. If the LLM knew it was making a mistake, wouldn't it just not make it? Of course, it's not possible for an LLM to actually "know" anything in that sense of the word.