So by your definition of creativity, the LLM is always being creative because it's always using probability to determine the next word (it's not just spitting o

So by your definition of creativity, the LLM is always being creative because it's always using probability to determine the next word (it's not just spitting out facts from a database). Hallucination is just when that prediction, or creativity as you call it, is wrong.