3 ms·
They aren't deepseek at all but Distill models. In LLM what distillation means is the better models trains ( fine tune ) the smaller models with their knowledge
by v3ss0n 2y ago
They aren't deepseek at all but Distill models.
In LLM what distillation means is the better models trains ( fine tune ) the smaller models with their knowledge ( responses) so the smaller models are also getting better.