3 ms·
> Personally I ended up writing my own autodiffing tensor library in C++ But this will not be a general library right ? You must have only included certain sub
by thecleaner 7y ago
> Personally I ended up writing my own autodiffing tensor library in C++
But this will not be a general library right ? You must have only included certain subset of functions of TF or PyTorch or whatever. Autodiffing is also included in certain proprietary libraries like ones from NAG. But I doubt its possible to achieve 50x speedup without compromising on functionality.
- svantana 7y agoOf course it's a herculean task to write a library with that many features. But I don't think that's the issue, it's more that the devs of TF can't possibly optimize for every use case. For me, I knew what kind of ops I needed, so I could focus on getting those as fast as possible.