3 ms·
The math doesn't make sense, 30B on a million GPUs = 30k per GPU. They're expensive but not that expensive, and definitely not in bulk.
by moralestapia 3y ago
The math doesn't make sense, 30B on a million GPUs = 30k per GPU. They're expensive but not that expensive, and definitely not in bulk.
- kristofferR 3y agoThat's actually less than the price they fetch during this shortage: https://www.cnbc.com/2023/04/14/nvidias-h100-ai-chips-selling-for-more-than-40000-on-ebay.html https://www.cnbc.com/2023/04/14/nvidias-h100-ai-chips-sellin... https://www.tomshardware.com/tech-industry/artificial-intelligence/nvidias-h100-ai-gpus-cost-up-to-four-times-more-than-amds-competing-mi300x-amds-chips-cost-dollar10-to-dollar15k-apiece-nvidias-h100-has-peaked-beyond-dollar40000 https://www.tomshardware.com/tech-industry/artificial-intell... However, they are likely vastly cheaper in bulk at MSRP, that's true. And Meta apparently got them before the AI hype cycle.