30 ms·
Suprised to find out that there is not a simple abstraction layer that makes it the same across all platforms.
by amelius 4y ago
Suprised to find out that there is not a simple abstraction layer that makes it the same across all platforms.
- criddell 4y agoI would have been more surprised to find out there was. Simple is rarely goes along with ML / AI libraries. Any abstraction layer will add overhead and probably present a lowest common denominator interface. The audience willing to accept those costs is small.
- amelius 4y ago> Any abstraction layer will add overhead and probably present a lowest common denominator interface. The audience willing to accept those costs is small. Eh ... lots of people use Tensorflow or Torch.
- hprotagonist 4y agowhich together are about 5 separate abstraction layers that don’t agree with each other. (tf 1,2, keras, torch, torch functional, …) so we add onnx and trt on top! that’ll help, right?
- nmfisher 4y agoThat was the idea behind ONNX, which has been somewhat successful. But if you’ve ever had to deploy these models, you’ll know it’s never as simple as promised. Different libraries use different ops, have weird export requirements or even noticeable performance issues.