4 ms·Have you tried generating two sets of qapairs, one with bad answers, and using DPO?by gbickford 3y agoHave you tried generating two sets of qapairs, one with bad answers, and using DPO?lewq 3y agoNot yet, sounds promising!