5 ms·
15k is the price to buy a GPU, not to run it, you'd have to account for electricity costs which isn't so straight forward.
by nodja 4y ago
15k is the price to buy a GPU, not to run it, you'd have to account for electricity costs which isn't so straight forward.
- ithkuil 4y agoThe point was that if you only need to train once, then it's cheaper to rent the GPUs than to buy them. If you need to train it multiple times, then the cost of buying the GPUs is amortized among runs. In any case the cost per run is going to be lower than 30m
- iszomer 4y agoI'm sure that's the case. The latest sku I'm responsible for QC testing now contains 4x A100's in a 2U chassis. And oh man the number of QSFP ports it utilizes..