4 ms·
It's very rare that you'll be at the exact point where it does make sense to use the "not quite high-power GPU racks". * Lowest short term costs favors "just u
by ElectricalUnion 11mo ago
It's very rare that you'll be at the exact point where it does make sense to use the "not quite high-power GPU racks".
* Lowest short term costs favors "just use the Cloud" solutions, that will often have power, HVAC and space constraints that favors new GPUs.
* Lowest long term costs bias the cost analysis to OPEX, where old GPUs gets expensive very fast, as they use more power, HVAC and space for less compute.