3 ms·
> People have been saying this for years, yet most training and a majority(?) of inference is done in PyTorch. The usual symptom of "cheaper to waste more reso
by TeMPOraL 3y ago
> People have been saying this for years, yet most training and a majority(?) of inference is done in PyTorch.
The usual symptom of "cheaper to waste more resources than do it properly"?
- brucethemoose2 3y agoThat, but I think many users don't even know its an option to try. I am hoping torch 2.1 improves this situation. torch.compile should "just work" much more often with `dynamic=true`, and its widespread usage might make people wonder "what other cost-reducing compilation frameworks are out there?"