5 ms·
I agree with dbfclark that it's case by case. At Skymind (https://skymind.io/ https://skymind.io/), we support an open-source Java library (http://deeplearning4
by vonnik 10y ago
I agree with dbfclark that it's case by case. At Skymind (https://skymind.io/ https://skymind.io/), we support an open-source Java library (http://deeplearning4j.org/ http://deeplearning4j.org/).
* So obviously Java, Scala, Clojure, and lower-level languages like C++, C and CUDA.
* Since deep learning needs very large datasets to train on, our engineers need experience with open-source libraries used in production environments, such as Hadoop, Spark, Kafka. We also work with Lagom, Nifi, etc.
* A lot of the same math underpins many machine learning and deep learning algorithms. So a high degree of comfort with linear algebra, calculus and probability is a plus.
* A general knowledge of the strengths and weaknesses of various algorithms -- neural networks, reinforcement learning, etc. -- their combinations and applications is helpful.
The Github repos are here if you're curious:
https://github.com/deeplearning4j/deeplearning4j/ https://github.com/deeplearning4j/deeplearning4j/
- jason_slack 10y agoCan you do CUDA with AMD GPUs? AMD Fire GPUs from a Mac Pro
- ngould 10y agoMy understanding is the CUDA interface is for NVIDIA GPU's only. There are non-CUDA API's for other types of GPU's, but they don't necessarily work out of the box with neural network libraries like Tensorflow yet.
- jason_slack 10y agoSo really you need a box with Nvidia GPUs to begin
- lovelearning 10y agoNot necessarily. If you want to start with CUDA, you can buy EC2 instances with GPUs and pay for time used. If you want to start with deep learning, you don't need GPUs or CUDA. All the popular frameworks work fine on CPUs. GPUs are not guaranteed to accelerate all deep learning use cases; sometimes the time taken to transfer data to and from GPU dominates the time taken to process that data. If you want to start with deep learning using an AMD GPU, Theano has support for OpenCL which is an alternative to CUDA. But as I understand, this support still remains limited and incomplete.
- jason_slack 10y agoI also saw this: https://github.com/hughperkins/DeepCL https://github.com/hughperkins/DeepCL OpenCL library to train NN. This could be an alternative to Theanos.
- eivarv 10y agoWorth noticing: development of an OpenCL-based backend for Theano is in under way [1]. I don't know how it's progressing (as I haven't checked it's status for a while), though, but some [2-3] GitHub issues might be worth checking out. [1]: http://deeplearning.net/software/theano/tutorial/using_gpu.html#gpuarray http://deeplearning.net/software/theano/tutorial/using_gpu.h... [2]: https://github.com/Theano/Theano/issues/2936 https://github.com/Theano/Theano/issues/2936 [3]: https://github.com/Theano/Theano/issues/1471 https://github.com/Theano/Theano/issues/1471
- deleted 10y ago[deleted]