3 ms·
Pytorch uses different kernels depending on the input size. There is a reason why it's so massive to download.
by GaggiX 1y ago
Pytorch uses different kernels depending on the input size. There is a reason why it's so massive to download.
- reliabilityguy 1y agoSure, some degree of customization is expected. However, I doubt that PyTorch implements every input size separately.
- saagarjha 1y agoGenerally tiling to a handful of sizes gets you pretty close to "specialized to this size" performance.
- reliabilityguy 1y agoSure, but the size can be anything.
- saagarjha 1y agoYes, you pick the size that’s closest