Looking back to the recent 'semianalysis' article on NVIDIA: https://www.semianalysis.com/p/nvidias-plans-to-crush-competition https://www.semianalysis.com/p/nv

Looking back to the recent 'semianalysis' article on NVIDIA: https://www.semianalysis.com/p/nvidias-plans-to-crush-competition https://www.semianalysis.com/p/nvidias-plans-to-crush-compet... 'For those OEMs to win larger H100 allocation, Nvidia is pushing the L40S. Those OEMs face pressure to buy more L40S, and in turn receive better allocations of H100.' Lots of articles and opinions popping out about the L40S as a serious H100 alternative at the same time. The people buying these kinds of cards have already been looking seriously (10-12k easy to source against 35k impossible to get?) and rejected them because for training memory bandwidth, intranode (nvlink) and internode (pcie5 and... Nvlink too?) interconnect, and tensor core performance are critical. Now if your application is fp32 and compute bound (or mostly compute bound) or if you can make it fly with cuda cores and bit of tensor cores, a bit of work yes, and you're still on Eth200G (so pcie 4 is OK) the L40 is an incredible beast and you can build incredibly dense compute nodes with up to 700 TFLOPS which is just mad.