3 ms·
The irony of this comment is rich. >The final softmax layer gives a per-token probability, but that is not the same thing as overall confidence in the response
by famouswaffles 3y ago
The irony of this comment is rich.
>The final softmax layer gives a per-token probability, but that is not the same thing as overall confidence in the response.
Clearly not.
https://imgur.com/a/3gYel9r https://imgur.com/a/3gYel9r
- munchler 3y agoHah, I wasn’t aware of that. Does it say how the base model computes its confidence? Is it requested in the prompt?
- famouswaffles 3y agoThey didn't specify.
- singularity2001 3y agoThis may be philosophically one of the most important graphs regarding the current state of AI! It shows that large language models already DO have an internal model of confidence in their statements, all that is needed is to train the models to output this confidence alongside their hallucinations if the confidence is low.