3 ms·
No, because it is not a distillation, but an extension. A selling point of the model is using RL to push past the quality of the base model.
by esafak 2y ago
No, because it is not a distillation, but an extension. A selling point of the model is using RL to push past the quality of the base model.