> one of the things you have to judge is how accurate the answer is. The LLM can't assess that Not quite true. Some LLMs are surprisingly good at predicting th

> one of the things you have to judge is how accurate the answer is. The LLM can't assess that Not quite true. Some LLMs are surprisingly good at predicting their confidence in answers (where a series of 80% confidence output should end up being right 80% of the time.) “Language Models (Mostly) Know What They Know” by Anthropic: https://www.anthropic.com/index/language-models-mostly-know-what-they-know https://www.anthropic.com/index/language-models-mostly-know-...