>That's pretty funny to think that an LLM can be certain or not, given its just a statistical output. What do you imagine a statistical output is ? and why do

>That's pretty funny to think that an LLM can be certain or not, given its just a statistical output. What do you imagine a statistical output is ? and why do you imagine you can't be certain about it ? LLM are not picking words out of a bag at random and neither are they just blindly picking the most frequent words in the training set. What do you imagine all that computation is doing? >given that it has no model of the meaning of any of the words in its output to compute certainty in the form of correspondence with reality? Says who ? I mean basically all the research (quite a few) on the topic points to LLMs having a pretty good idea of the certainty and truth of their outputs internally. Some pretrained models even have the logit probabilities directly correspond to the probability of being right (https://imgur.com/a/3gYel9r https://imgur.com/a/3gYel9r). Statistics is not magic. LLMs clearly have a model of the meaning of the words they use amongst many other things.