The fundamental technology of LLMs *is* statistical hallucination. What's the probability of a sequence of tokens given a context? That's what LLMs answer. I a

The fundamental technology of LLMs *is* statistical hallucination. What's the probability of a sequence of tokens given a context? That's what LLMs answer. I am not one to talk in absolutes but the basic circumstances of current LLMs have hallucination at their core and can likely not be guaranteed fact based. It's just an expression of likelihood where you rely on your training data to contain truths. This is why OpenAI gives more weight to Wikipedia than Reddit comments - the model contains no reasoning mechanism. It ought to be treated more as a fallible human rather than a superintelligent lookup resource based on fact checked data.