4 ms·
The GPU rental market is fairly reasonable. There's lots of companies doing it. (I work at one of them). 4x 4090 can be fetched for around $0.40/hour on some pl
by kristopolous 2y ago
The GPU rental market is fairly reasonable. There's lots of companies doing it. (I work at one of them). 4x 4090 can be fetched for around $0.40/hour on some platforms ... about $1.20 on others depending on how available you want it. Regardless, all in, you can do an average 10-or-so-day train for < $500.
If you want on-prem, wait a few months. The supply of 5000 series (probably announced at CES in a few days) should push more 4000 on the market and, maybe, for a bit, over-supply and push the price down.
Nvidia stopped manufacturing the 4000 a few months ago because they don't have endless factories. Those resources were reallocated to 5000 series and thus pushed the price for the 4000 up to the ridiculous place it is now (about $2,000 on ebay)
I think the current appetite for crypto and ai is big enough to consume all 4000 and 5000 series cards to a point of scarcity (even 3090s are still fetching about $1000) but there should be a window where things aren't crazy expensive coming up.
There's no evidence supply will continually outstrip demand unless something unusual happens.
- whimsicalism 2y agodon't you need nvlink? feel like an 80gb a100 would start being worth it at a $1.20/4x 4090 price point
- kristopolous 2y agoSome suppliers have support for it, some don't. They either use docker or kvm and it depends on how clever their hosting software is. We can do it, but that's a recent thing. it's really hit or miss
- whimsicalism 2y ago? sorry i really don't understand this reply... some suppliers have support for nvlink on 4090? i doubt that
- deleted 2y ago[deleted]
- yieldcrv 2y agoHow soon could I break even on renting my GPUs out?
- kristopolous 2y agois your electricity free? Some of these cards probably cost about $0.10/hr to run ... depending on your card/electricity rate etc. It's probably somewhere between 12months-never depending on how the market shakes out. Maybe 2 years is a good idea ... really, if power is cheap/free and the machine is on and idle then it's free money - that's the way to look at it.
- yieldcrv 2y agoMy electricity is not free, I would be satisfied with partially subsidizing these units too though
- kristopolous 2y agoWell ok, I guess I'll plug my employer's site for setting up: https://cloud.vast.ai/host/setup https://cloud.vast.ai/host/setup There's a lot of competition in the "airbnb gpu" so if you don't like us, the number is around 12 or so globally. We're probably either #2 or #3. Companies don't really disclose these things so it's hard to know. Some people probably list on more than one platform. There may be some host management software somewhere that helps with that. I haven't actually checked. I'd be happy to talk more about these privately. Some are better than others and I've got no interest posting less than charitable things about our competitors publicly, regardless of how accurate I think it is. My email is in my profile.
- lostmsu 2y agoIf you are on Windows, take a look at https://borg.games/setup https://borg.games/setup (founder here) We aim at $1200/y for 3090, so around a year given descent electricity prices. Highly recommend setting a lower power limit (usually 250W for 3090).