3 ms·
that's really surprising to me, because I used to run a GPU cloud that was cheaper than amazon, and the margins were insane.
by dnautics 5y ago
that's really surprising to me, because I used to run a GPU cloud that was cheaper than amazon, and the margins were insane.
- Enginerrrd 5y agoIt all comes down to utilization as a percentage of time. If the workloads are infrequent enough, GPU cloud providers on going to crush the onsite equipment. However... I was also sort of surprised, because last time I priced this out, you can have pretty low utilization rates of the equipment and still come out ahead.
- dnautics 5y agothe other thing to consider though is that if you are under pressure by management to not utilize GPU cloud, you might do fewer experiments than if you had at least a GPU workstation under the desk. (that, presumably, you can share with other workmates)
- wiz21c 5y agoI've looked for some GPU on the web and it's super expensive to rent. I was expecting to rent that for say 50$ per month (considering I can rent some webspace for less then 10$ a month) but everything was more expensive like 600$/month (I look for entry level GPU, used just a bit, I'm a student) ... Did I look correctly ?
- dnautics 5y agoif you want an always-on gpu for $50/mo? That's unreasonable. Consider how much "building from scratch" even a cheap "minimal" GPU unit costs (let's say 3k GPU + 1k supporting PC), whereas a cheap "building from scratch minimal webspace" is a fraction of a single CPU unit, so let's say $100-ish/unit dollars, to be really generous. A rented non-fractional GPU should be easily minimally 40x the cost of a website. Don't expect these ratios to be authoritative; there are obviously different economies of scale and many many details I papered over, but this should just give you an idea of the back of the envelope "relative costs"; just that 5x is way out of the range you should have guessed.