> Instead, it’s more appropriate to think of LLMs as always hallucinating. That matches my mental model as well. To get rid of hallucinations, "I don't know" w

> Instead, it’s more appropriate to think of LLMs as always hallucinating. That matches my mental model as well. To get rid of hallucinations, "I don't know" would have to be an acceptable answer, and it would have to output that when 'appropriate' ... Which, it doesn't know (and to be fair, neither do we most of the time, without some way of checking/validating(.