4 ms·
https://github.com/google/jaxonnxruntime https://github.com/google/jaxonnxruntime
by BenoitP 3y ago
https://github.com/google/jaxonnxruntime https://github.com/google/jaxonnxruntime
- jarym 3y agoI need the opposite - JAX to ONNX
- agibsonccc 3y agoI've been looking in to this for the java world. What's your use case? Deployment in to existing applications?
- jarym 3y agoYea exactly - Python for training, Java/.NET for inference at production. I looked at approaches like GRPC and things but my case is a bit more time-sensitive and the latency added by going over a network layer was too much. For now I'm happy with Pytorch->ONNX and then running the ONNX model directly. But as I said, that means I can't easily train using JAX :-(
- patrickkidger 3y agoYou can do JAX->TF->ONNX I believe: https://github.com/patrick-kidger/equinox/blob/main/equinox/internal/_onnx.py https://github.com/patrick-kidger/equinox/blob/main/equinox/...
- jarym 3y agoOhh, I'll check that out!