3 ms·
"Top performance thus requires top-of-the-line GPUs." Would be curious to see the data around the economics of the different options.
by josh_carterPDX 10y ago
"Top performance thus requires top-of-the-line GPUs."
Would be curious to see the data around the economics of the different options.
- komali2 10y agoEspecially metrics comparing cost of getting your own vs offloading to AWS or whatever. When is the "break even" point for buying your own?
- visarga 10y agoSo, a single GTX 1080 GPU deep learning box would come around 1500$, if you pay 0.7$/hr for your cloud server, you should buy if you use more than 1500/0.7 = 2142h. So, if you need more than 90 days of GPU time, you should probably buy your box. Of course, if the cloud server is slower than GTX 1080, then the benefit is multiplied. But ... your own box would not be scalable. You'd still need AWS to speed up training.
- josh_carterPDX 10y agoSeems to be a tough business to bootstrap. Interesting. Thanks for laying that out.
- coredog64 10y agoAFAIK, AWS is stuck several architecture revisions behind Pascal (most things I see say it's still a Kepler GK104). At a best guess, that 1080 is probably 2x faster than any single GPU AWS instance.