Hallucination is a huge problem for statistical language models. (I avoid the term “LLM” because it isn’t clear what “large” is, and the problem isn’t limited t

Hallucination is a huge problem for statistical language models. (I avoid the term “LLM” because it isn’t clear what “large” is, and the problem isn’t limited to large models anyways.) The question is whether it is a fundamental issue of the architecture (in the same way that jets can fly but they can’t fly to the moon), or one that will be solved with sufficient engineering patches. RLHF is just one “plugin” on top of the transformer, but maybe others like some kind of expert system can add further improvement. There are a lot of people in both camps and a lot of money to be made selling one vision or another. GOFAI folks like Stuart Russell would argue that it’s fundamental and can’t be done. I think it’s an empirical question with a lot of VC money riding on yes.