4 ms·
A month ago I ran benchmarks on CPUs vs. GPUs on Google Compute Engine, and found that GPUs were now about as cost-effective as using preemptible instances with
by minimaxir 9y ago
A month ago I ran benchmarks on CPUs vs. GPUs on Google Compute Engine, and found that GPUs were now about as cost-effective as using preemptible instances with a lot of CPUs: http://minimaxir.com/2017/11/benchmark-gpus/ http://minimaxir.com/2017/11/benchmark-gpus/
That was before preemptible GPUs: with the halved-cost, the cost-effectiveness of GPU instances now doubles, so they're a very good option for hobbyist deep learning. (I did test the preemptible-GPU instances recently; they work as you expect)
- viridian 9y agoIt's also a huge gain to a number of science disciplines that don't have access to a mainframe or supercomputer, but have development resources.
- candiodari 9y agoYes, because as we all know, university teams don't have access to hardware, but are swimming in money. (obviously the whole point of doing cloud for the cloud providers is that owning the hardware is cheaper) Whilst I would agree that university teams probably should use the resources the cloud providers make available freely, they should probably stay away from actually using capacity on the cloud and instead have their own hardware. Besides, what I keep hearing from machine learning researchers is that no matter where you work, developing on your own machine ... there's no beating that, time and productivity wise.
- viridian 9y agoCan't disagree with that, but for some genomics work it's just not a realistic option when you can get output from a slice of mainframe in 1/10th the time, and that time is like 2 and some change days.
- Spivak 9y agoI used to do IT for a large research university. I can confirm that we were practically drowning in funding for new hardware. If we made a business case for upgrading our infrastructure it wasn't uncommon to get an extra million or so dollars in the budget without much thought.
- saycheese 9y agoRelated HN post to your blog post on the benchmarks on CPUs vs. GPUs on Google Compute Engine: https://news.ycombinator.com/item?id=15940724 https://news.ycombinator.com/item?id=15940724
- Eridrus 9y agoI'm always disappointed in these comparisons since they never look at AWS spot instances, which are the real competitors for hobbyists.
- minimaxir 9y agoI put a note about spot instances at the end (the economics of spot instances are a bit tricker for calculating cost-effectiveness due to price variability). Although the cost of a K80 preemptible instance on GCP is now close to the approximate cost of a K80 spot instance on AWS, so there's a bit of competition.
- boulos 9y agoDisclosure: I work on Google Cloud (and helped launch this). Note that our pricing is flat regardless of number of GPUs attached (and you don't need to buy as many cores to go with them). By comparison, Spot often charges greater than on-demand pricing for anything other than single GPU instances. Thanks again for your write up, sorry about the confusion as we delayed announcement until the new year.
- maksimum 9y agoI think the real competitors for hobbyists are physical GTX 1060s. Hobbyist cloud-computing is a different question though.
- cobookman 9y agoDoesn't Nvidia's new eula make that Difficult. Anything requiring more than a handful of gpus would be classified as a data center deployment. Which is against the eula. IANAL though so I might have interpreted this incorrectly. http://www.nvidia.com/content/DriverDownload-March2009/licence.php?lang=us&type=GeForce http://www.nvidia.com/content/DriverDownload-March2009/licen...
- amelius 9y agoI'm not getting it. Do they want to sell a product or a service? And instead of restricting our rights, shouldn't we get a discount when buying multiple GPU cards?
- deleted 9y ago[deleted]