Yeah. An MLM basically just computes the mostly likely thing based on its training, and says that. If it has no knowledge of a thing, it still calculates the

Yeah. An MLM basically just computes the mostly likely thing based on its training, and says that. If it has no knowledge of a thing, it still calculates the most likely thing, which is a hallucination since it can't possible calculate that effectively. Regurgitating false statements is not a hallucination, it's bad training data. It's the difference between being wrong and just making things up from nothing.