3 ms·
I don't know why you were downvoted. There are no "larger" ops. However, things like RNNs can require more memory to execute because of the longer chain of dat
by nl 8y ago
I don't know why you were downvoted.
There are no "larger" ops. However, things like RNNs can require more memory to execute because of the longer chain of data they need to execute the operations on.
As noted in the article you can alleviate this by halving the size of the model at the cost of accuracy.
The heat in large GPUs is because of the large number of cores they have operating simultaneously.