2 ms·
"I dunno" would have to be marked as a good or neutral response in the RLHF process, and that seems like a problematic training incentive.
by brucethemoose2 4y ago
"I dunno" would have to be marked as a good or neutral response in the RLHF process, and that seems like a problematic training incentive.
- sebzim4500 4y agoIn an ideal world "I don't know" would be considered worse than a correct answer but much better than a wrong answer. In the UK, there is a competition called the "junior maths challenge", or something, which is a multiple choice quiz where correct answers are +1 and incorrect answers are -6 (so guessing has negative EV). I think we need a similar scoring system here.