3 ms·
Is it faster for large models, or are the optimizations more noticeable with small models? Seeing that the benchmark uses a 0.6B model made me wonder about that
by Gracana 1y ago
Is it faster for large models, or are the optimizations more noticeable with small models? Seeing that the benchmark uses a 0.6B model made me wonder about that.
- tough 1y agoI have not tested it but its from a deepseek employee i don't know if it's used in prod there or not!