3 ms·
just to be clear, I doubt that deepseek was produced via distillation Yeah, your technical point is kind of ridiculous here that in all my uses of distillatio
by joe_the_user 2y ago
just to be clear, I doubt that deepseek was produced via distillation
Yeah, your technical point is kind of ridiculous here that in all my uses of distillation (and in the comment I quoted), distillation is used in informal sense and there's no allegation that DeepSeek could have been in possession of OpenAI's model weights, which is what's needed for your "Distillation (term of Art)".
- ada1981 2y agoI’m not sure why folks don’t speculate China is able to obtain copies of OpenAI's weights. Seems reasonable they would be investing heavily in plaing state assets within OpenAI so they can copy the models.
- joe_the_user 2y agoBecause it feeds conspiracy theories and because there's no evidence for it? Also, let's talk DeepSeek in particular, not "China". Looking back on the article, it is indeed using "distillation" as a special/"term of art" but not using it correctly. IE, it's not actually speculating that DeepSeek obtained OpenAI's weights and distilled them down but rather that it used OpenAI's answers/output as a starting point (which there is a different method/"term of art").