3 ms·
Neat idea, but it seems to be born out of current market conditions and might not be sustainable going forward once supply/demand for GPUs normalize. As someon
by paxys 5y ago
Neat idea, but it seems to be born out of current market conditions and might not be sustainable going forward once supply/demand for GPUs normalize.
As someone running these workloads I'd only be desperate enough to pay $250/mo for a 3090 today because I cannot buy it for $1500 at the store straight up. And if you drop the price by a third now it isn't worth it for the host anymore.
- d110af5ccf 5y agoElectricity plus some small premium should be tenable under any market condition. At least it works for public clouds so far even as hardware prices have fluctuated over time. There will likely always be someone who'd rather briefly rent than buy. I do wonder if what's charged for electricity and premium can be competitive with large data centers in the long run. Amazon already has spot pricing. I expect it would be favorable for consumers with cheap electricity or who are already paying to heat their house. I also wonder what effect renewables increasing electricity spot price volatility might have on this market in the future.
- paxys 5y agoPublic clouds have economies of scale, reliability and capacity all working in their favor. There's a reason there has never been a market for renting out spare CPU cycles or hard disk space or any other resource piecemeal from your computer.
- lmeyerov 5y agoDO and friends wouldn't exist in the CPU side if that was true, so a spot economy in GPU side makes sense, and even more so bc they are higher-end time shares Even if we didn't have an open ticket with Azure since Christmas for more GPUs, the ability to burst non-sensitive tasks on say 20 cheaper GPUs for 5-30 min is attractive. That stuff adds up fast, and lowering cost both opens accessibility for low-end users and helps scale what power users can do. My bigger surprise is vast has been around awhile and only ~20 available servers, so I'm guessing < 100 total. Is this a friction issue?
- thebean11 5y agoWhat if instead of 1 GPU for a month, you need 10 GPUs for 24 hours? Renting is a lot more flexible in that way.