4 ms·
AMD can get ~65% more mi300x from the same 5nm wafer than Nvidia can get H100s
- thulle 3y agoDoes it matter? Is wafer cost that large of a fraction of the price of these insanely expensive cards?
- thisislife 3y agoFrom the article: > Nvidia needs 65% more 5nm wafers to produce the same number of GPUs. Basically all else being equal and scaled, AMD has 65% more capacity than Nvidia, when it comes to the most critical part of the production. > 5nm dies are the most expensive part of the whole solution, meaning there is also a 65% pricing advantage (though some of this advantage is offset by more complex packaging and other cheaper dies that go into mi300x as well as more HBM chips).
- thulle 3y ago> 5nm dies are the most expensive part of the whole solution, meaning there is also a 65% pricing advantage (though some of this advantage is offset by more complex packaging and other cheaper dies that go into mi300x as well as more HBM chips). That doesn't say anything about the fraction of the cost on the finished product though? Those numbers just say it could be something like 2% vs 6% of the cost of the card.
- SpecialistK 3y agoPricing breakdowns are going to be hard to come by, as they're negotiated and confidential. But I think it would be safe to say that leading-edge core dies are going to be a sizable plurality (if not majority) of the cost. Only memory would come close (and some of those Reddit comments suggest more, due to it being HBM), as power delivery and other small components like resistors just aren't that expensive. The trickier bit to measure is R&D, as it's both a fixed cost and one that can be spread across several products.
- thulle 3y agoThe 608.5 mm² 4090 with 76.3 B transistors isn't too far off from the 814 mm² H100 w 80 B transistors. Seems like mostly more area for memory interfacing? Assuming they're not selling the 4090 at a loss and being generous that the whole cost is the chip cost, that makes for a $1600 chip. Scaled to the H100 we get $2140. That's a pretty minuscule fraction of a $35k card.
- az226 3y agoCOGS for an H100 is about $3-4k.
- plasmatix 3y agoGiven the insane demand for these things right now, the real cost is not being able to sell it.
- thulle 3y agoThat makes sense though, are the chips themselves the bottleneck in production?
- whaleofatw2022 3y agoGood point... at 35ish chips per wafer (although I would -hope- nvidia provisioned things sanely to help yields or otherwise bin) an increase in fully good Chips is still better than binning.
- wmf 3y ago1. Remember that "bad" GPU dies are still usable; they disable the defective cores. 2. If CoWoS is the bottleneck the rest doesn't matter as much.
- thrtythreeforty 3y ago1. Maybe. Depends on how much design-for-yield they did. A GPU is good for this vs other ASICs because it has lots of copies of the same blocks. 2. Still reduces cost per die which, at these package sizes, is significant.
- ksec 3y ago>they disable the defective cores. Exactly. Especially on GPU. It is not like CoWoS is free either. But it means AMD is more flexible with its product strategy.
- anigbrowl 3y agoThis is an interesting twist, though idk if superior yields and price strategy can overcome Nvidia's huge toolchain/follower advantages. AMD's production advantages are only likely to persist for 1 or 2 model generations, no?
- az226 3y agoYeah but nvidia is selling H100s at like 90% margin so it’s not like the cost of manufacturing is that relevant.
- rasz 3y agomore like 300-500%
- drexlspivey 3y agoI would expect these new GPUs to use the new 3nm nodes from last year. Is Apple hogging all TSMC production?
- wmf 3y agoYes, Apple bought all TSMC N3 for some time. Other customers will start to use it in 2024.