Operator overloading is a major reason why libraries like pytorch exist so IMO that's a moot point. Btw there's ongoing work to automatically optimize expressi

Operator overloading is a major reason why libraries like pytorch exist so IMO that's a moot point. Btw there's ongoing work to automatically optimize expressions like this. See the XLA compiler for example. Right now deep learning has a ton of seemingly obvious compute/memory optimisations that are not done automatically.