3 ms·
The GPU chip is Nvidia's GK104, which was released in 2012. Amazon's GPUs are similarly old. You'll train models twice as fast with a Titan X installed in your
by modeless 11y ago
The GPU chip is Nvidia's GK104, which was released in 2012. Amazon's GPUs are similarly old. You'll train models twice as fast with a Titan X installed in your local machine, without having to deal with distributing the training.
When will we see the first cloud machine learning provider with up-to-date GPUs?
- matheweis 11y agoIs it? Their website (http://www.rescale.com/pricing/ http://www.rescale.com/pricing/) says they have Kepler K520 and Tesla K40. No affiliation with them at all, and haven't logged in yet, but I've been looking for something like this too, so I was hopeful until I saw your comment...
- gpoort 11y agoIt is not the only hardware on Rescale. K520 and K40 are definitely available - after you create a free account and login there is a very transparent price list of the hardware available to you. (works at Rescale)
- kramimus 11y agoYes, I agree, that hardware is aging. We are currently working on making K80s available and should be ready in the next couple months. (works at Rescale)
- modeless 11y agoK80 is still Kepler based. Why not Maxwell?
- kramimus 11y agoK80s are only our next release, we do not plan to stop there.
- dgacmu 11y agohttps://thevirtualhorizon.com/2016/04/09/whats-new-in-nvidia-grid-licensing/ https://thevirtualhorizon.com/2016/04/09/whats-new-in-nvidia... (tl;dr - you have to pay more to wrap the GPU access in a VM. Like, $550/more, plus a year of software support, according to that article. IANAL and haven't read any of the license details, so I don't know if there are more gotchas.)
- deleted 11y ago[deleted]
- betelgeusem 11y agoNervana Systems http://www.nervanasys.com/products/ http://www.nervanasys.com/products/ is using Titan X's for their cloud.
- modeless 11y agoInteresting. Does that require you to use Neon though? Also, seems like a "contact us for quote" kind of situation.
- gcr 11y agoHow much RAM do GK104 chips have? Wikipedia seems to imply it's about 3GB, but that's even smaller than EC2 GPU instances' 4GB. Many modern models really need the maximum 12GB to train.
- kleer001 11y agoGood point. Especially for me as I'm not quite up to date with knowlege about all the GPU business (other than they're screamingly fast) It's still scads faster than my 8 year old laptop that I'm stuck with at the moment.