3 ms·
H100s are now around 30k USD if you're lucky, going up to 40k on Ebay/Amazon. 3,584 GPUs at $30,000 is $104,550,000 USD only in GPUs.
by m00x 3y ago
H100s are now around 30k USD if you're lucky, going up to 40k on Ebay/Amazon.
3,584 GPUs at $30,000 is $104,550,000 USD only in GPUs.
- godelski 3y agoWe're talking about building a server, so usually availability is different than to a home consumer. But fwiw lambda has their Node for 330k (which gets pretty close to that price), whereas the A100's are $170k, so double my figure. Especially considering the H100 nodes are 8U instead of 4U. so you need twice as many racks.
- m00x 3y ago30k is to businesses, not consumers. Consumers don't buy H100s.