2 ms·
Seems it was fine with instruction fine-tuning. Then gone with the RLHF.
by famouswaffles 4y ago
Seems it was fine with instruction fine-tuning. Then gone with the RLHF.
- cubefox 4y agoI don't think the paper says that. I would guess both SL and RL cause mode collapse.