5 ms·
Training - I have a feeling it's going to be NVidia for a while. AMD just doesn't show interest in joining the party, and NVidia has been optimising CuDNN for a
by dharma1 10y ago
Training - I have a feeling it's going to be NVidia for a while. AMD just doesn't show interest in joining the party, and NVidia has been optimising CuDNN for a while now, it will take a bit of time to play catch up. I really don't understand what AMD have been doing the past 2 years here.
Inference - NVidia will have a much harder time enforcing a monopoly here, because they are not, and cannot be the dominant player on all the hardware where neural networks will run after training. ARM, Qualcomm and others in mobile space will be pushing it hard, as will vendors running neural nets on FPGA/ASIC designs that are now emerging.
Will be interesting to see what effect architectures using low precision or binary weights (for both training and inference) will have too on the hardware landscape.
SPIR-V - AFAIK Codeplay (https://www.codeplay.com https://www.codeplay.com) are working on SPIR-V support for tensorflow, that should in theory help to use TF on various hardware that supports Vulkan/SPIR-V. But I guess each vendor will still need to tune things like convolution kernels for their specific hardware to squeeze the best perf out
- chronic6l 10y agoYou realize that deep learning is such a small market and will be small in the context of GPUs?
- dharma1 10y agocould have fooled me http://fortune.com/2016/11/10/nvidia-earnings-stock-machine-learning/ http://fortune.com/2016/11/10/nvidia-earnings-stock-machine-...
- muyuu 10y agoIn the article there's a comparison of earnings by usage. It remains comparatively small.
- dharma1 10y agoFor now. It's also hard to say, how much of the rise in their "gaming" earnings - is in fact driven by people buying GPUs for deep learning. Everyone I know who are doing deep learning have been buying Titan X's or GTX 1080's - their "gaming" cards. Not the datacentre or pro viz cards.
- muyuu 10y agoI think you might be overestimating the worldwide impact of that, though. AMDs are used for "mining crypto" - they're the best for that purpose - and no, that also is nothing to write home about. Despite being very present in my personal circles. The amount of people doing either is minuscule in comparison to gaming. Those buying big for datacentres are definitely accounted for by nVidia. They don't buy GTX cards.