4 ms·
How do I, with a very nice AMD GPU, and running on Windows, play around with any sort of GPU accelerated learning for anything? Last I knew, pretty much nothing
by mrguyorama 7y ago
How do I, with a very nice AMD GPU, and running on Windows, play around with any sort of GPU accelerated learning for anything? Last I knew, pretty much nothing worked with either of those caveats.
- apl 7y agoRunning Windows is perfectly fine; the major libraries for GPU-accelerated autodiff and networks (CUDNN with Pytorch or Tensorflow) have great support nowadays. It's the AMD GPU that remains essentially useless, as of 2019. If you want to get into the game, I'd recommend buying a middle-of-the-road NVIDIA GPU like the RTX2060. For toying with autodiff and basic CNNs, CPU works just fine by the way...
- mrguyorama 7y ago>It's the AMD GPU that remains essentially useless, as of 2019 I guess more important question... Whyyyyyyyyyyyyy
- jawilson2 7y agoProbably support for CUDA over OpenCL.
- ChrisRackauckas 7y agoCuBLAS and CuDNN are just better libraries than what exist on OpenCL right now. Until that changes it'll be hard to switch for numerical work.
- dragandj 7y agoThe point is that and AMD GPU is far from useless. The only thing that it DOES lack is the out of the box from major Python/R/whatever libraries. Why? Not because AMD GPU does not work, but because most (perhaps all) of these high-level libraries rely of underlying performance libraries provided by Nvidia. Despite all the talk about autodiff this or that, the stuff that matters is implemented by hand by Nvidia and Intel engineers and then high level libraries build on top. AMD is simply lagging in providing low-level C libraries and GPU kernels for that. For example, let me chip in with the libraries I develop, in Clojure, no less. They support BOTH Nvidia GPU AND AMD GPU backends. Most of the stuff is equally good on AMD GPU and Nvidia GPU. With less fuss than in Julia and Python, I'd argue. Check out Neanderthal, for example: https:neanderthal.uncomplicate.org Top performance on Intel CPU, Nvidia GPU, AND AMD GPU, from Clojure, with no overhead, faster than Numpy etc. You can even mix all three in the same thread with the same code. Lots of tutorials are available at https://dragan.rocks https://dragan.rocks I'm writing two books about that: Deep Learning for Programmers: An Interactive Tutorial with CUDA, OpenCL, MKL-DNN, Java, and Clojure [1] and Numerical Linear Algebra for Programmers: An Interactive Tutorial with GPU, CUDA, OpenCL, MKL, Java, and Clojure [2] Drafts are available right now at https://aiprobook.com https://aiprobook.com [1] https://aiprobook.com/deep-learning-for-programmers https://aiprobook.com/deep-learning-for-programmers [2] https://aiprobook.com/numerical-linear-algebra-for-programmers https://aiprobook.com/numerical-linear-algebra-for-programme...
- abrichr 7y ago>It's the AMD GPU that remains essentially useless, as of 2019. This appears to finally be starting to change. See: https://github.com/RadeonOpenCompute/ROCm https://github.com/RadeonOpenCompute/ROCm https://github.com/ROCmSoftwarePlatform/tensorflow-upstream/ https://github.com/ROCmSoftwarePlatform/tensorflow-upstream/
- fulafel 7y agoYeah, this deplorable state of the software on GPU side is the reason that GPGPU is staying a niche technology for the foreseeable future.
- nscalf 7y agoFor me, the easiest thing has been to set up a google cloud compute server with a good gpu. They start you off with a $300 credit good for one year and charge like $0.50/hour to run. You can get pretty solid models running in the scale of minutes. Spend your time learning, not setting up.