2 ms·
At this point ONNX is the most mature inference engine for mobile. Had the joy of playing around with TFLite, Pytorch Mobile, GGML for work and nothing came cl
by vishnumohandas 2y ago
At this point ONNX is the most mature inference engine for mobile.
Had the joy of playing around with TFLite, Pytorch Mobile, GGML for work and nothing came close to ONNX in terms of stability across a wide array of devices.
Also, model conversions are a breeze.