4 ms·

you already have TVM for the cross platform stuff see https://tvm.apache.org/docs/how_to/deploy/android.html https://tvm.apache.org/docs/how_to/deploy/android.

by homarp 3y ago

you already have TVM for the cross platform stuff see https://tvm.apache.org/docs/how_to/deploy/android.html https://tvm.apache.org/docs/how_to/deploy/android.html or https://octoml.ai/blog/using-swift-and-apache-tvm-to-develop-ml-apps-for-the-apple-ecosystem/ https://octoml.ai/blog/using-swift-and-apache-tvm-to-develop... or https://github.com/mlc-ai/mlc-llm https://github.com/mlc-ai/mlc-llm

refulgentis 3y ago
My deepest thanks, I owe you one. Overlooked this completely. & spent dozens of hours learning way too much to still fall short of understanding how to make it work in ONNX.