3 ms·
It kind of does, mathematically. It doesn't label confidence. If 0.0001% of answers is a lie, without knowing which parts are a lie exactly, you cannot trust an
by mstaoru 1mo ago
It kind of does, mathematically. It doesn't label confidence. If 0.0001% of answers is a lie, without knowing which parts are a lie exactly, you cannot trust any of them.
If you need to independently verify every fact, why not just gather facts yourself in the first place.
Let's say, a mathematical concept of lie. I still use them every day, of course.
- alansaber 1mo ago"why not just gather facts yourself" vs "i use them every day", the duality of man. But yes, I appreciate that LLM output is theoretically completely untrustworthy- but when in practice I observe that it's around 90% accurate, I have to rely on my own internal calibration for how useful it is (depends on type, nature of task ofc)
- mstaoru 1mo agoAs they say, the less you know, the better LLM output is. :D