3 ms·
The per unit cost here is electricity. Those GPUs suck down enough during inference that it is not negligible.
by dotancohen 1y ago
The per unit cost here is electricity. Those GPUs suck down enough during inference that it is not negligible.
- hermitcrab 1y agoDepends on the type of software. Some software have significant support costs.
- SideburnsOfDoom 1y agoAWS or Azure do charge per-usage, but not in line with usage of electricity. They're well above that.