3 ms·
Standard convolutions are not memory bandwidth bound for common sizes/shapes. Convolutions run much faster using the TC than not using them. Depthwise convolu
by ekelsen 6y ago
Standard convolutions are not memory bandwidth bound for common sizes/shapes. Convolutions run much faster using the TC than not using them.
Depthwise convolutions are different though - they usually are bandwidth bound.
- easde 6y agoIt's true that depthwise convolutions are bandwidth bound, but most networks that use them in combination with a kernel size 1 "convolution". If those two operations are tiled and fused together, the result is often compute bound again. This is usually not the case in most ML frameworks and libraries though, including CuDNN.