3 ms·
Yeah I'm surprised that there's not at least some sort of conviction metric being outputted along the LLM response. I mean it's all probability right? Must be
by mupuff1234 1y ago
Yeah I'm surprised that there's not at least some sort of conviction metric being outputted along the LLM response.
I mean it's all probability right? Must be a way to give it some score.
- bravesoul2 1y agoNot sure. In RLHF you are adjusting the weights away from wrong answers in general. So this is being done. I think the closest you can get without more research is another model checking the answer and looking for BS. This will cripple speed but if it can be more agentic and async it may not matter. I think people need to choose between chat interface and better answers.