4 ms·
What's the (pre-Ampere) GCP price for a V100? On AWS it was $3/hr, so at 100% use and market prices a Titan V would pay for itself vs the cloud inside a month.
by jjoonathan 6y ago
What's the (pre-Ampere) GCP price for a V100? On AWS it was $3/hr, so at 100% use and market prices a Titan V would pay for itself vs the cloud inside a month. Is GCP significantly cheaper? Or are we talking about pricing at ~0% utilization?
- TylerE 6y ago100% utilization is a pretty huge assumption. And if you ARE actually running it that hard, you'd better budget for fairly frequent replacement cards.
- jjoonathan 6y agoAt 50% utilization it beats the cloud in 2 months. 10% utilization, it beats the cloud within a year. If you're dabbling, definitely go with the cloud, but if you're turning around experiments on a regular basis, buying gets attractive quickly. And no, cards don't just keel over in a few months at 100%. Crypto miners ran that experiment. A typical card has years of 100% in it.
- TylerE 6y agoOnly if your power is free (it isn't) and the machine the card is in is free (it isn't) and said machine produces no heat or noise (it does).
- nullifidian 6y agoPower doesn't cost nearly as much for TCO to get anywhere near even the "preemptible price" of V100 (and probably A100 when it's ready) over a period of half a year. And now that 3090 has 24gb, which is needed for larger models, a solution with a couple of consumer cards is even more competitive for experimentation. You can also sell your cards in a year or two, and recover some of the costs. (All that of course if Nvidia's gimping of consumer cards doesn't significantly affect your code)
- gambiting 6y agoSo for the people who I know do it professionally, the answer is really simple - when they run calculations for clients, they can add GCP compute time on the invoice. You can't bill a client for your own electricity usage. I mean you can factor it into the price of your service, but then that brings a whole pile of other issues with it.
- jjoonathan 6y agoCloud if: - Someone else is paying - You expect to dabble - You need burst capability Buy if: - Cost sensitive & capable
- jjoonathan 6y agoI rounded down AWS's price by $.06/hr, more than the price of electricity and cooling around here.
- Karunamon 6y agoWait, what? I used to mine crypto on GPU back when that was a profitable thing to do, which involves leaving the card maxed out for long periods of time.. no real damage. Are modern cards really so fragile you can expect them to die off under heavy use even if properly cooled and not overclocked?
- jjoonathan 6y agoNo, they are not that fragile.
- ls612 6y agoNo. Obviously people who use them for gaming can play for thousands of hours at 100% utilization and they will last for many years on average.