3 ms·
Misconceptions. There's no inherent reason a false statement would have lower probability than a true one. To be clear, I'm referring to things like GPT-3.5 re
by jamilton 3y ago
Misconceptions. There's no inherent reason a false statement would have lower probability than a true one.
To be clear, I'm referring to things like GPT-3.5 reportedly consistently messing up on statements like "what's heavier, two pounds of feathers or a pound of bricks". Being consistently wrong in the same way implies to me (but I don't know for sure) that the class of response is high probability in an absolute sense.
I can't find the article that demonstrated the sort of things that GPT consistently gets wrong, but it was things like common misconceptions and sayings.
- ajcp 3y agoVery interesting. So it could produce, with high confidence, common and real-world guesses found in it's dataset. So in that case it's not guessing and not wrong; it's indeed producing something that is correct, but still false. Now we're really getting into the weeds here though.