4 ms·

Very excited to see these kinds of techniques, I think getting a 30B level reasoning model usable on consumer hardware is going to be a game changer, especially

by jarbus 1y ago

Very excited to see these kinds of techniques, I think getting a 30B level reasoning model usable on consumer hardware is going to be a game changer, especially if it uses less power.

apples_oranges 1y ago
Deepseek does reasoning on my home Linux pc but not sure how power hungry it is
- gcr 1y ago
  what variant? I’d considered DeepSeek far too large for any consumer GPUs
  - scosman 1y ago
    Some people run Deepseek on CPU. 37B active params - it isn't fast but it's passible.
    - danielbln 1y ago
      Actual deepseek or some qwen/llama reasoning fine-tune?
      - scosman 1y ago
        Actual Deepseek. 500gb of memory and a threadripper works. Not a standard PC spec, but a common ish home brew setup for single user Deepseek.