3 ms·
I think when they were figuring out RLHF they avoided this by interleaving RLHF and normal cross entropy on training set gradients.
by zaptrem 1y ago
I think when they were figuring out RLHF they avoided this by interleaving RLHF and normal cross entropy on training set gradients.