I don't work in LLMs, but I use a ton of similar tools to model biology, and I really like the term "hallucinate." I would argue that the LLM does have a concep

I don't work in LLMs, but I use a ton of similar tools to model biology, and I really like the term "hallucinate." I would argue that the LLM does have a concept of reality, in the form of a probabilistic distribution over sentence structure. And that probability distribution does not match the reality that I live in, even if it matches the LLM training data and training procedure fairly well. I would argue that even a simple random forest model has a concept of reality, or maybe is a concept of reality, though a faulty one.