4 ms·
The network retains the same topology, and therefore the same matrix dimensions, but some elements are set to zero, removing their contribution.
by feanaro 3y ago
The network retains the same topology, and therefore the same matrix dimensions, but some elements are set to zero, removing their contribution.
- AlexErrant 3y agoRelevant excerpt from https://news.ycombinator.com/item?id=38656172 https://news.ycombinator.com/item?id=38656172 > ...if we meet the shape 512x512 (512 is a power of 2, therefore a very "round" number in computer science), then maybe some kernel will be very fast; but then on a 512x511matrix, the same kernel may need to add some padding first to transform it into a round 512x512 matrix with zeros at the end of each row. Adding those zeros means shifting all rows, which is a very costly operation.