3 ms·
that seems wrong.. don't llms runs on probability distributions? Won't they have confidence built in?
by shreyshnaccount 3y ago
that seems wrong.. don't llms runs on probability distributions? Won't they have confidence built in?
- yreg 3y agoI don't think probability of tokens can be mistaken for confidence of knowledge being correct. I'd take it more as a fitness whether the tokens fit naturally in the sentence.
- shreyshnaccount 3y agoMakes sense, but i wonder if there's some way to retrofit that functionality onto it