3 ms·
I've really liked having this in my prompt: > Prefer numeric statements of confidence to milquetoast refusals to express an opinion, please. Supply confidence
by spiffytech 2y ago
I've really liked having this in my prompt:
> Prefer numeric statements of confidence to milquetoast refusals to express an opinion, please. Supply confidence rates both for correctness, and for completeness.
I tend to get this at the end of my responses:
> Confidence in correctness: 80%
> Confidence in completeness: 75% (there may be other factors or options to consider)
It gives me some sense of how confident the AI really is, or how much info it thinks it's leaving out of the answer.
- pacifika 2y agoUnfortunately the confidence rating is also hallucinated.
- spiffytech 2y agoOh yeah, I know ChatGPT doesn't really "know" how confident it is. But there's still some signal in it, which I find useful.
- Aachen 2y agoMakes me curious what the signal to noise is there. Maybe it's more misleading than helpful, or maybe the opposite