3 ms·
Who said blatant distillation was wrong? It just shows that Chinese “labs” are dependent on the US. Also, from a scientific perspective, distillation is deca
by thesmtsolver2 2mo ago
Who said blatant distillation was wrong?
It just shows that Chinese “labs” are dependent on the US.
Also, from a scientific perspective, distillation is decades old and contributes nothing scientifically.
- willy_k 2mo ago> Also, from a scientific perspective, distillation is decades old and contributes nothing scientifically. Distillation itself does not, but it does enable research by allowing more teams to play around with models that follow the frontier, as opposed to completely independent training including scaffolding up w/ synthetic data.