4 ms·
Do you know of any good explanations of the techniques you used for those who only touch PyTorch Eager + occasionally torchscript?
by upbeat_general 4y ago
Do you know of any good explanations of the techniques you used for those who only touch PyTorch Eager + occasionally torchscript?
- ipiszy 4y agoYou could check "AITemplate optimizations" section in the blog (https://ai.facebook.com/blog/gpu-inference-engine-nvidia-amd-open-source/ https://ai.facebook.com/blog/gpu-inference-engine-nvidia-amd...), and https://github.com/facebookincubator/AITemplate#more-about-aitemplate https://github.com/facebookincubator/AITemplate#more-about-a.... The basic idea is to do aggressive kernel fusions.