3 ms·
> When a caller asks something that isn’t in the knowledge base, the AI doesn’t guess. I've seen a number of instances of this type of thing in wild, and under
by tqi 7mo ago
> When a caller asks something that isn’t in the knowledge base, the AI doesn’t guess.
I've seen a number of instances of this type of thing in wild, and under the hood it's usually some prompt that asks the llm to gauge confidence in its own answer. And from my admittedly naive understanding of how this all works, this seems extremely unlikely to be accurate. But I'm curious if that's still the case or if I'm operating under pre-2026 information?
- sleazebreeze 7mo agoTop of the line models still routinely get this wrong. This is just "make no mistakes" with more steps.
- tqi 7mo agoThat is my understanding as well, but I see it so often and stuff changes so quickly it's hard to tell what is real.