I dislike this notion of “hallucination”, because it makes it seem as if it’s unusual. LLMs are language models, not repositories of facts. They have a lot of

I dislike this notion of “hallucination”, because it makes it seem as if it’s unusual. LLMs are language models, not repositories of facts. They have a lot of facts at their disposal, so they know how to make something look factual. “Hallucinating” is just them doing what they’re supposed to. It’s not aberrant. As such, anyone relying on them as some sort of oracle is doing things very wrong.