3 ms·
How would the smaller units handle larger ops and convolutions, RNNs and others? Even assuming custom chips, all that heat that is generated (which gpus use lar
by viksit 8y ago
How would the smaller units handle larger ops and convolutions, RNNs and others? Even assuming custom chips, all that heat that is generated (which gpus use large fans and heat sinks for dissipation) has to be removed somehow. Won’t that be a problem?
- viksit 8y agoDownvotes without explanations?
- nl 8y agoI don't know why you were downvoted. There are no "larger" ops. However, things like RNNs can require more memory to execute because of the longer chain of data they need to execute the operations on. As noted in the article you can alleviate this by halving the size of the model at the cost of accuracy. The heat in large GPUs is because of the large number of cores they have operating simultaneously.