3 ms·
Most of the performance on coding comes from RL, not distillation. Distillation helps with world knowledge and things like that.
by nl 5mo ago
Most of the performance on coding comes from RL, not distillation.
Distillation helps with world knowledge and things like that.