3 ms·
Doesn’t the model want to make the user happy? Its responses sure seem like it does. I’d be happier with its responses if it was honest about when it was not
by SirMaster 3y ago
Doesn’t the model want to make the user happy?
Its responses sure seem like it does.
I’d be happier with its responses if it was honest about when it was not confident in its answer.
- famouswaffles 3y agoGo look at the first link I sent. Rewarding for "making users happy" destroys GPT-4's calibration. Why would "making users happy" incentivize for truth ?
- SirMaster 3y agoBecause getting truthful answers would make users happier? Seems like common sense to me. Who’s asking the chat bot questions not looking for or wanting a truthful answer a lot of the time? If the model understood or captured “human interest” at all in its training this should be pretty fundamental to its behavior.
- olddustytrail 3y agoYes, the computer wants you to be happy. Happiness is mandatory. Failure to be happy is treason.