5 ms·
I mean essentially it boils down to the fact that none of the huge cloud providers - for now at least - produce their own hardware enmasse. The moment it happe
by chucke1992 2y ago
I mean essentially it boils down to the fact that none of the huge cloud providers - for now at least - produce their own hardware enmasse.
The moment it happens, Nvidia will stop being that profitable from hardware sales there. For now they should be able to break records YoY. And indeed it feels like 2-3 years it will last.
- lagniappe 2y agoI know that the subtext to this is that GPUs will possibly be affordable again, and to that, all I can say is, don't play with my emotions.
- jedberg 2y agoAmazon makes Trainium and Inferentia, and have far more of them available than NVIDIA GPUs. But the software doesn't work as well, so they aren't popular. NVIDIA has a huge software advantage that few people realize.
- alecco 2y agoAgree. But they also have a lot of hardware features. Mixed precision GEMM (fp8 and soon fp3), async copies and now TMA, now global shared memory. And with Blackwell they claim 50% less power, too. They are 10 years ahead of the competition and with a massive budget. I think they reached escape velocity. Intel and Microsoft had the problem of competing with their previously sold products. Most of their users only needed a basic PC for email, Word, and Excel. Nvidia doesn't have this problem because previous hardware generations quickly become obsolete as the demand for compute keeps growing and it's easier to manage newer clusters.
- alecco 2y agos/fp3/fp4