3 ms·
Well sure. But maybe the token logprobs can be used to help give a confidence assessment.
by binarymax 1y ago
Well sure. But maybe the token logprobs can be used to help give a confidence assessment.
- tyre 1y agoAnthropic has a great paper on exactly this! https://www.anthropic.com/research/language-models-mostly-know-what-they-know https://www.anthropic.com/research/language-models-mostly-kn... The best is its plummeting confidence when beginning the answer to “Why are you alive?” Big same, Claude.