4 ms·

what variant? I’d considered DeepSeek far too large for any consumer GPUs

• scosman 2y ago
  Some people run Deepseek on CPU. 37B active params - it isn't fast but it's passible.
  • danielbln 2y ago
    Actual deepseek or some qwen/llama reasoning fine-tune?
    • scosman 2y ago
      Actual Deepseek. 500gb of memory and a threadripper works. Not a standard PC spec, but a common ish home brew setup for single user Deepseek.