3 ms·
Run your deepseek R1 model on your own hardware.
by htrp 2y ago
Run your deepseek R1 model on your own hardware.
- girvo 2y agoOnly various distillations are available for most people’s hardware, and they’re quite obviously not as good as actual R1 in my testing.
- sampo 2y ago"$6,000 computer to run Deepseek R1 670B Q8 locally at 6-8 tokens/sec" https://reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_computer_to_run_deepseek_r1_670b_q8_locally/ https://reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_comput...