2 ms·
I have never tried this, but I'm wondering how effective the following approaches would be to measure uncertainty and unknowns in responses: https://cookbook.o
by TZubiri 1y ago
I have never tried this, but I'm wondering how effective the following approaches would be to measure uncertainty and unknowns in responses:
https://cookbook.openai.com/examples/using_logprobs https://cookbook.openai.com/examples/using_logprobs
According to OpenAI official cookbook it seems to be a fairly standard usecase.
Another approach, especially in classification, would be to measure the cosine distance between the user embedding, and the ideal embedding of the message category.