Thanks for the reply. "show that the performance component and the "convert your model for deployment" component can be disentangled" makes sense. Also, I like

Thanks for the reply. "show that the performance component and the "convert your model for deployment" component can be disentangled" makes sense. Also, I liked the part of the article about torch.compile producing faster matrix-vector multiplication than cublas. I've seen the same thing on CPU, that it's way faster to just write and manually optimize a loop over a bunch of dot products than it is to use BLAS routines because of how simple the "matmul" actually is. I don't know how widely known that is.