2 ms·
>These services are created to give the best product to users, and so wouldn't this be a better product? Therefore there is incentive. Happier users and a produ
by famouswaffles 3y ago
>These services are created to give the best product to users, and so wouldn't this be a better product? Therefore there is incentive. Happier users and a product that is better than competitors.
Why would the computation care about any of that ? I'm talking about incentive for the model.
- hutzlibu 3y ago"I'm talking about incentive for the model. " In Douglas Adams Hitchhikers Guide to the Galaxy, this is (somewhat) fixed by giving the AIs emotion ..
- SirMaster 3y agoDoesn’t the model want to make the user happy? Its responses sure seem like it does. I’d be happier with its responses if it was honest about when it was not confident in its answer.
- famouswaffles 3y agoGo look at the first link I sent. Rewarding for "making users happy" destroys GPT-4's calibration. Why would "making users happy" incentivize for truth ?
- SirMaster 3y agoBecause getting truthful answers would make users happier? Seems like common sense to me. Who’s asking the chat bot questions not looking for or wanting a truthful answer a lot of the time? If the model understood or captured “human interest” at all in its training this should be pretty fundamental to its behavior.
- olddustytrail 3y agoYes, the computer wants you to be happy. Happiness is mandatory. Failure to be happy is treason.
- ooterness 3y agoIncentive for the model is to survive RLHF feedback from contract workers who are paid to review LLM output all day. They're paid for quantity, not quality. Therefore, optimum strategy is to hallucinate some convincing lies.