3 ms·
> Deepseek R1 Distill 8B Q40 on 1x 3080, 60.43 tok/s (eval 110.68 tok/s) That wouldn't get on Hacker News ;-)
by varispeed 2y ago
> Deepseek R1 Distill 8B Q40 on 1x 3080, 60.43 tok/s (eval 110.68 tok/s)
That wouldn't get on Hacker News ;-)
- jckahn 2y agoHNDD: Hacker News Driven Development