2 ms·
How is China further behind if distillation cannot stop? I think it's a reasonable strategy to follow, even if they could train from scratch.
by davyAdewoyin 17d ago
How is China further behind if distillation cannot stop? I think it's a reasonable strategy to follow, even if they could train from scratch.
- undeveloper 17d agodistillation results in a worse product than the actual teacher model iirc
- SXX 17d agoNobody care if Chinese models are only 99%, 95% or 90% as good as SotA US models. Because we only have weights and able to self-host Chinese ones. Gemma 4 and GPT OSS are nice to have, but nowhere close to that.