4 ms·
You mean the asian models which just distilled American ones? I'm happy Mistral is doing their own ground up research. SOTA frontier models are a commodity with
by DarkNova6 2mo ago
You mean the asian models which just distilled American ones? I'm happy Mistral is doing their own ground up research. SOTA frontier models are a commodity with little room for second places.
Mistral is playing the smart money on vertical products rather than horizontal ones. The former requires finesse, the latter brute strength.
- maigret 2mo ago“Distilled”? I mean what model is not distilled from other data? The American models happily trained from my blog and social media data without any kind of rewards. If I can pay the inference I don’t see why I wouldn’t do this. Also, I have not seen proof that the US lab do not use other models for training either.
- DarkNova6 2mo agoI'm referring to the formal usage of the term "distillation", instead of the informal one that refers to training it on any data as a whole. https://www.geeksforgeeks.org/nlp/what-is-llm-distillation/ https://www.geeksforgeeks.org/nlp/what-is-llm-distillation/