Hallucination is not an LLM "edge case." It is their normal and only state of operation. It just so happens that 'guess the next word' algorithms are capable of

Hallucination is not an LLM "edge case." It is their normal and only state of operation. It just so happens that 'guess the next word' algorithms are capable of a reasonable frequency of success owing to the fact that a lot of our language is probably mostly redundant, making it possibly 'hallucinate' reasonable statements quite regularly. Take what I wrote above. If you were given the context of what I have already written, then you could probably fill in most of what I wrote, to a reasonable degree of accuracy, after "It is their normal..." Because the issue is obvious and so my argument largely writes itself. To some degree even this second paragraph does.