3 ms·
Does it also produce a confidence number?
by downrightmike 2y ago
Does it also produce a confidence number?
- ravetcofx 2y agoI don't think openAI's api for gpt4o-mini has any such mechanism.
- wildzzz 2y agoThe AI says it's 100% confident that it's hallucinations are correct.
- tensor 2y agoNo, there is no vision LLM that produces confidence numbers to my knowledge.
- ndr_ 2y agoThe only thing close are the "logprobs": https://cookbook.openai.com/examples/using_logprobs https://cookbook.openai.com/examples/using_logprobs However, commenters around here noted that these have likely not been fine-tuned to correlate with accuracy - for plaintext LLM uses. Would be interested in hearing finding for MLLM use-cases!