4 ms·
I have also been running the 32b version on my 24GB RTX 3090.
by mv4 2y ago
I have also been running the 32b version on my 24GB RTX 3090.
- rocho 2y agoThat's not DeepSeek, it's a Qwen or Llama model distilled from DeepSeek. Not the same thing at all.
- mv4 2y agoif someone wants to run the real thing (R1) locally, someone posted their hardware specs on X. Total cost: $6,000. [0] direct link with login https://x.com/carrigmat/status/1884244369907278106 https://x.com/carrigmat/status/1884244369907278106 [1] alt link without login https://threadreaderapp.com/thread/1884244369907278106.html https://threadreaderapp.com/thread/1884244369907278106.html
- testrun 2y agoI am doing the same.