> An LLM doesn’t “know” anything in the way you’re imagining. It doesn’t have stored facts or indexed knowledge to check against Neither does your brain and ye

> An LLM doesn’t “know” anything in the way you’re imagining. It doesn’t have stored facts or indexed knowledge to check against Neither does your brain and yet you do "know" something. > but it might just as easily produce a plausible-sounding but wrong one, even if the correct information was in the training data If the majority of information that was in the LLM's training data said 1 + 1 = 3, the LLM will tell you that 1 + 1 = 3, even if there was some information that said 1 + 1 = 2, and there's nothing wrong with that because the LLM is not supposed to fact-check. > the model’s training biases it toward correct sequences more often than incorrect ones No, the model's training biases it toward sequences that appear more frequently.