2 ms·
Is there any indication of whether the correlation was destroyed during the supervised finetuning or during the RLHF phase? Or are there even two phases any mor
by sebzim4500 4y ago
Is there any indication of whether the correlation was destroyed during the supervised finetuning or during the RLHF phase? Or are there even two phases any more?
- famouswaffles 4y agoSeems it was fine with instruction fine-tuning. Then gone with the RLHF.
- cubefox 4y agoI don't think the paper says that. I would guess both SL and RL cause mode collapse.