3 ms·
There is a trend towards larger models in the state of the art of deep learning research. The total cost of the on-chip memory on the NVidia GPU is still a goo
by pama 6y ago
There is a trend towards larger models in the state of the art of deep learning research. The total cost of the on-chip memory on the NVidia GPU is still a good value proposition compared to current custom deep learning accelerators. This cost to get to large on-chip memory, combined with the flexibility of CUDA for other types of scientific applications, makes it harder for such accelerators to compete with Nvidia in such large academic research clusters. I hope that this situation changes over the next couple of years.
- anonymousDan 6y agoIs this really true? At least for inference I've seen data showing the trend is rather for smaller models that exploit sparsity.