Interesting. One problem with this approach might be that as we start using RLHF to teach LLMs how to be “nice”, we might dissuade them from making statements t

Interesting. One problem with this approach might be that as we start using RLHF to teach LLMs how to be “nice”, we might dissuade them from making statements that actually reflect objectively real human selfishness. Related: https://astralcodexten.substack.com/p/how-do-ais-political-opinions-change https://astralcodexten.substack.com/p/how-do-ais-political-o...