3 ms·
"Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud." And I think they, the DeepSeek team, finetunes Qwen 7b on DeepSeek. That i
by Mashimo 2y ago
"Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud."
And I think they, the DeepSeek team, finetunes Qwen 7b on DeepSeek. That is how I understood it.
Which apparently makes it quite good for a 7b model. But, again: if I understood it correctly, is still just qween and without the reasoning of DeepSeek.
- randomifcpfan 2y agoIn my application, code generation, the distilled DeepSeek models (7B to 70B) perform poorly. They imitate the reasoning of the r1 model, but their conclusions are not correct. The real r1 model is great, better than o1, but the distilled models are not even as good as the base models that they were distilled from.