11 ms·
LLMs have no idea if they hallucinate ≠ LLM make no mistakes. The former statement is a bold claim that would require some sort of evidence. The latter nobody
by kolinko 2y ago
LLMs have no idea if they hallucinate ≠ LLM make no mistakes.
The former statement is a bold claim that would require some sort of evidence. The latter nobody really argues with.
- lewispollard 2y ago"Hallucinate" is just a term we've come up with for LLMs making mistakes. If the LLM knew it was making a mistake, wouldn't it just not make it? Of course, it's not possible for an LLM to actually "know" anything in that sense of the word.