4 ms·
Only various distillations are available for most people’s hardware, and they’re quite obviously not as good as actual R1 in my testing.
by girvo 2y ago
Only various distillations are available for most people’s hardware, and they’re quite obviously not as good as actual R1 in my testing.
- sampo 2y ago"$6,000 computer to run Deepseek R1 670B Q8 locally at 6-8 tokens/sec" https://reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_computer_to_run_deepseek_r1_670b_q8_locally/ https://reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_comput...