3 ms·
The article says: > We’re testing H100’s PCIe version on Lambda Cloud, which enables 114 of those SMs, 50 MB of L2 cache, and 10 HBM2 memory controllers. The c
by twic 3y ago
The article says:
> We’re testing H100’s PCIe version on Lambda Cloud, which enables 114 of those SMs, 50 MB of L2 cache, and 10 HBM2 memory controllers. The card can draw up to 350 W.
> Nvidia also offers a SXM form factor H100, which can draw up to 700W and has 132 SMs enabled.
So i wonder if the number of enabled elements is due to a power supply or cooling constraint.
- raverbashing 3y agoVery possible, including some PCI limits (even though you probably have an auxiliary port) It's also possible the yields are not so great and then you have a limited number of good SMs per chip