It's interesting to me that people use the word "hallucinate" to describe when an LLM provides incorrect information, when it is doing the exact same process as

It's interesting to me that people use the word "hallucinate" to describe when an LLM provides incorrect information, when it is doing the exact same process as when it happens to get things right: predicting a reasonably likely next token. It's "hallucinating" in the same way y=x^2 will predict the next point in a curve.