3 ms·

https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/ https://digitalspaceport.com/how-to-run-deepseek-r1-671b-ful...

• muricula 2y ago
  Is that a CPU based inference build? Shouldn't you be able to get more performance out of the M3's GPU?
  • wmf 2y ago
    Inference is about memory bandwidth and some CPUs have just as much bandwidth as a GPU.