3 ms·

You will have to explain to me how.

• radlad 2y ago
  https://news.ycombinator.com/item?id=42897205 https://news.ycombinator.com/item?id=42897205
• bmelton 2y ago
  https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/ https://digitalspaceport.com/how-to-run-deepseek-r1-671b-ful...
  • muricula 2y ago
    Is that a CPU based inference build? Shouldn't you be able to get more performance out of the M3's GPU?
    • wmf 2y ago
      Inference is about memory bandwidth and some CPUs have just as much bandwidth as a GPU.