> “The original reason why they hallucinate is because if you don’t guess anything, you don’t have any chance of succeeding,” This is a better answer than the

> “The original reason why they hallucinate is because if you don’t guess anything, you don’t have any chance of succeeding,” This is a better answer than the one I was going to give about it not being in the training data. > Claude’s system prompt instructs the model that when people ask about niche information that would likely be difficult to find on the internet, it should warn them its answer might be a hallucination. This seems kind of crude, but I have to imagine they’ve explored entropy-based methods. I wonder why that didn’t pan out.