3 ms·
> R1 distillations are going to hit us every few days I'm hoping someone will make a distillation of llama8b like they released, but with reinforcement learnin
by wkat4242 2y ago
> R1 distillations are going to hit us every few days
I'm hoping someone will make a distillation of llama8b like they released, but with reinforcement learning included as well. The full DeepSeek model includes reinforcement learning and supervised fine-tuning but the distilled model only feature the latter. The developers said they would leave adding reinforcement learning as an exercise for others. Because their main point was that supervised fine-tuning is a viable method for a reasoning model. But with RL it could be even better.