An LLM is Always making things up - that’s what it Does. It is a corpus of word (token) probabilities and a function to generate probabilistic paths through the

An LLM is Always making things up - that’s what it Does. It is a corpus of word (token) probabilities and a function to generate probabilistic paths through them from a starting point. It is always hallucinating, it just often hallucinating things that also happen to exist.