3 ms·
This has been disproven by multiple experiments, and also - there is nothing in the transformer architecture that would suggest this. On the contrary - even the
by kolinko 2y ago
This has been disproven by multiple experiments, and also - there is nothing in the transformer architecture that would suggest this. On the contrary - even the most basic classifier neural networks by default produce not a binary answer, but an answer with confidence level.
- lewispollard 2y agoAnd if that confidence level is high enough for it to output an answer, but that answer is wrong or nonsensical, what do we call it?
- ben_w 2y agoIn humans? Overconfidence.
- kolinko 2y agoLLMs have no idea if they hallucinate ≠ LLM make no mistakes. The former statement is a bold claim that would require some sort of evidence. The latter nobody really argues with.
- lewispollard 2y ago"Hallucinate" is just a term we've come up with for LLMs making mistakes. If the LLM knew it was making a mistake, wouldn't it just not make it? Of course, it's not possible for an LLM to actually "know" anything in that sense of the word.