3 ms·

Do you mean that there is no correlation between confidence and false positives or other errors?

• ramity 1y ago
  elzbardico is pointing out how the author is having the confidence value generated in the output of the response rather than it being the confidence of the output.
  • bckr 1y ago
    Is there research solid knowledge on this?
    • baby 1y ago
      this trick is being used by many apps (including Github copilot reviews). The way I see it, is that if the agent has an eager-to-please problem, then you give it a way out
      • bckr 1y ago
        Thanks. I was talking about the confidence measure.