One way to think of LLM output is that it is all hallucination. Sometimes it happens to coincide with reality. To an LLM it’s all the same as there’s no relati

One way to think of LLM output is that it is all hallucination. Sometimes it happens to coincide with reality. To an LLM it’s all the same as there’s no relationship to reality, just to likelihood to reality. It’s the difference between “this is something that Peter might say” and “this is something that Peter said”. To LLMs there’s no distinction.