5 ms·
> The main reason we use NVIDIA hardware is because it's cheaper per FLOP ... well... and largely because most neural network software only supports CUDA and/o
by Alupis 8y ago
> The main reason we use NVIDIA hardware is because it's cheaper per FLOP
... well... and largely because most neural network software only supports CUDA and/or has rudimentary OpenCL support.
Nvidia hardware isn't really cheaper per FLOP in all cases, AMD and Nvidia still leapfrog each other back and forth.
- etaioinshrdlu 8y agoSure, but every framework has full support for CPUs.
- Alupis 8y agoThat's true to a point... latest versions of TensorFlow, for example, have caused a few issues with instruction sets that not all CPU's (even produced today) have.
- walterbell 8y agoIs that because of CPUs that are only available at major cloud providers?
- Alupis 8y agoNo, not entirely. AVX instruction set, for instance, seems to only be on select Intel and AMD cpu's, even modernly manufactured ones. TensorFlow changed to requiring AVX since version 1.4 (Nov 2017), which has caused grief for many users... even those with recent/performant systems.