4 ms·In InstructGPT there is a direct pretraining gradient addition as well as KL penaltyby tempusalaria 2y agoIn InstructGPT there is a direct pretraining gradient addition as well as KL penalty