3 ms·
nVidia's Tesla processors and high-end GPUs are really stellar. We recently bought a machine with a Tesla K20c with some colleagues and the speed-up for neural
by danieldk 11y ago
nVidia's Tesla processors and high-end GPUs are really stellar. We recently bought a machine with a Tesla K20c with some colleagues and the speed-up for neural net training has been tremendous.
E.g. for some of my nets (NLP tasks) training time has gone from hours to 15-30 minutes. This is great when you are just experimenting with different approaches to a problem and want to iterate quickly.
It's also great that nVidia hasn't been sitting on their laurels and released a library (cuDNN) of NN primitives that nearly everyone has been rebasing their packages on.