> Realistically, no reason why the card shouldn't last at least 3 years If you have 10k H100s, the failure rate is about 3-5/day. In numbers, that is $90-150k/

> Realistically, no reason why the card shouldn't last at least 3 years If you have 10k H100s, the failure rate is about 3-5/day. In numbers, that is $90-150k/day or ~11%/year (3*365=1095) on the low end. Of course a lot of these cards can go off for RMA and come back to life eventually, but this is being actually realistic about it. You end up having to manage a whole RMA program and it is a constant stream of cards in and out.