4 ms·
This is insightful. I've been thinking that the problem is that GPT doesn't seem to have a sense of what is really true vs untrue (or conjecture or fantasy). M
by brianpan 4y ago
This is insightful. I've been thinking that the problem is that GPT doesn't seem to have a sense of what is really true vs untrue (or conjecture or fantasy).
Maybe it does, but it isn't letting the user in on the confidence level of its statements (essentially lying to the user, as you say).
- Kye 4y agoThe problem is: how do you communicate confidence? If it were 30% certain, I might try to relate it to something I do know. For example: MMO drop rates. 30% would seem high! And I honestly don't know whether it is or isn't for a system like this.
- famouswaffles 4y agoIf you read the technical paper, base GPT's confidence directly correlated with ability to perform problems accurately. Sadly, the hammer of alignment knocked it right out.
- getpost 4y agoWait a minute, didn't I learn in college decades ago that deciding what is true is equivalent to the halting problem? Meaning, it can't be done in principle. There might be practical ways to ascertain the truth for a useful subset of statements in certain domains, but we are a very long way from knowing the truth about arbitrary statements, if that is even possible.