6 ms·
The other factor at play is that Nvidia chips were originally designed for graphics processing tasks, which may not be the best architecture for AI.
by arbuge 9y ago
The other factor at play is that Nvidia chips were originally designed for graphics processing tasks, which may not be the best architecture for AI.
- twtw 9y ago... and were completely redesigned starting in the mid-2000s to be good general purpose parallel processors. Modern GPUs have very little specialized graphics hardware. This doesn't mean there aren't better architectures, but this idea that it's bad cause it's a graphics accelerator is horribly out of date.
- deepnotderp 9y agoA widely propagated myth. GPUs were largely programmable parallel processors by the time they became in vogue for deep learning. Bill Dally (nVidia chief scientist) has said that the hard wired graphics takes up so little die area that it is essentially negligible in terms of cost for them. Plus, the latest Volta chips have "tensor cores" the equivalent of little TPUs.