2 ms·

Is my understanding correct that they assumed a fixed size of the input? If so, why is it surprising that generic implementations in PyTorch are worse?

• GaggiX 1y ago
  Pytorch uses different kernels depending on the input size. There is a reason why it's so massive to download.
  • reliabilityguy 1y ago
    Sure, some degree of customization is expected. However, I doubt that PyTorch implements every input size separately.
    • saagarjha 1y ago
      Generally tiling to a handful of sizes gets you pretty close to "specialized to this size" performance.
      • reliabilityguy 1y ago
        Sure, but the size can be anything.
        • saagarjha 1y ago
          Yes, you pick the size that’s closest