> a temp of 0 doesn't reduce hallucinations. I never said it did. > LLMs internally know when they are hallucinating/taking a wild guess. No they don’t. If t

> a temp of 0 doesn't reduce hallucinations. I never said it did. > LLMs internally know when they are hallucinating/taking a wild guess. No they don’t. If they did we would be able to program them to not do so. I would argue that wild guesses are all LLMs are doing. They practically statistically guess their way to an answer. It works surprisingly well a lot of the time but they don’t really understand why they are right/wrong. P.S. LLMs are kind of like students who didn’t study for the test so they use “heuristics” to guess the answer. If the test setter is predictable enough, the student might actually get a few right.