4 ms·
H100s are available at increasingly affordable prices
by gdiamos 2y ago
H100s are available at increasingly affordable prices
- markhahn 2y agoyes, the AI bubble is at least deflating. that's what's so corrosive about media coverage and stock-market speculation: it corrupts any actual price signals in the market. there is not an infinite demand for AI training, let alone AI inference.
- robotnikman 2y agoNow if only they could be affordable for the average consumer... A man can dream...
- blihp 2y agoWhen we get to the end of the hype cycle, they will be. The only question is if people will be interested in footing the power bill for any of the ocean of obsolete data center GPUs that companies will be dumping.
- electronbeam 2y agoDepends on what yield AMD has, they may be able to undercut that if aiming for marketshare rather than revenue. The marginal cost of each chip is dollars. The 5 digit prices for H100s are just margins to be undercut
- gdiamos 2y agoAfter deep diving into building datacenters, I realized that traditional clouds (AWS, Google, azure) add a huge margin to GPUs like H100s. You can (and I think should), cut it out by going with coreweave, lambda, another or doing it yourself I’m okay paying that huge margin to first tier cloud for CPUs and disks, which are cheap, but not GPUs