5 ms·
But your estimate was explicitly based on running the 4-bit version. The full uncompressed Deepseek R1 model is 1.4TB. You'd need 16 h100s for this, and conside
by anigbrowl 4mo ago
But your estimate was explicitly based on running the 4-bit version. The full uncompressed Deepseek R1 model is 1.4TB. You'd need 16 h100s for this, and considering the new price for an 8 node cluster is about $350k, I think my estimate of $300k was pretty generous, assuming you'd buy used or liquidation or something.
https://www.gmicloud.ai/en/blog/2026-cost-of-renting-or-uying-nvidia-h100-gpus-for-data-centers https://www.gmicloud.ai/en/blog/2026-cost-of-renting-or-uyin...