2 ms·
https://www.reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_computer_to_run_deepseek_r1_670b_q8_locally/ https://www.reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000
by paxys 2y ago
https://www.reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_computer_to_run_deepseek_r1_670b_q8_locally/ https://www.reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_co...
According to this, you can fit it on a CPU-only setup (no GPUs) with 2 x AMD EPYC CPUs and 24 x 32GB DDR5-RDIMM RAM. About $6000 MSRP for the rig. Doubt you are going to get very many tokens/sec out of it though (6-8, according to the author).
- lxe 2y agoPretty impressive TPS numbers for CPU-only