4 ms·
Do we know how do these distilled versions perform in benchmarks?
by punkpeye 2y ago
Do we know how do these distilled versions perform in benchmarks?
- simonw 2y agoDeepSeek published a bunch of benchmarks when they released the models: https://github.com/deepseek-ai/DeepSeek-R1?tab=readme-ov-file#4-evaluation-results https://github.com/deepseek-ai/DeepSeek-R1?tab=readme-ov-fil... I'd like to see detailed benchmarks run by other unaffiliated organizations.
- punkpeye 2y agoThis is very useful. Thank you. so basically there is not much reason to go beyond DeepSeek-R1-Distill-Qwen-32B, at least for coding tasks
- punkpeye 2y agoJust had a chance to play around with 32B model https://glama.ai/models/deepseek-r1-distill-qwen-32b https://glama.ai/models/deepseek-r1-distill-qwen-32b I am using it with Cline VSCode extension to write code. It works impressively well for a model this size. Thanks again for sharing those benchmarks!