2 ms·
What's the math on the $50k nvidia cluster? My understanding these things cost ~$8k and you can at least get 5 for $40k, that's around half a tb. That being sa
by 3abiton 10mo ago
What's the math on the $50k nvidia cluster? My understanding these things cost ~$8k and you can at least get 5 for $40k, that's around half a tb.
That being said, for inference mac still remain the best, and the M5 Ultra will even be a better value with its better PP.
- reilly3000 10mo agoGPUs: 4x NVIDIA RTX 6000 Blackwell (96GB VRAM each) • Cost: 4 × $9,000 = $36,000 • CPU: AMD Ryzen Threadripper PRO 7995WX (96-Core) • Cost: $10,000 • Motherboard: WRX90 Chipset (supports 7x PCIe Gen5 slots) • Cost: $1,200 • RAM: 512GB DDR5 ECC Registered • Cost: $2,000 • Chassis & Power: Supermicro or specialized Workstation case + 2x 1600W PSUs. • Cost: $1,500 • Total Cost: ~$50,700 It’s a bit maximalist, but if you had to spend $50k it’s going to be about as fast as you can make it.
- deleted 10mo ago[deleted]
- broretore 10mo agoThis is basically a tinybox pro?