4 ms·
I can't seem to find anyone actually usefully trying this. Do you know of any data?
by candiodari 3y ago
I can't seem to find anyone actually usefully trying this. Do you know of any data?
- staticman2 3y agoNo but Google (for example) recommends fine-tuning based on at least 500 examples of question response pairs. DPO as far as I know requires a good and bad example. It's not a technique based on just saying "ai response is bad".