4 ms·
Tract looks neat, and I agree that making inference with rich signal support would be a killer app. I'd love if they did this with pytorch. Tensorflow is quick
by echelon 6y ago
Tract looks neat, and I agree that making inference with rich signal support would be a killer app.
I'd love if they did this with pytorch. Tensorflow is quickly falling out of favor.
Deploying models in Rust makes a lot of sense. It's a little rough around the edges, though. (I use Rust bindings to libtorch for https://vo.codes https://vo.codes )
Sonos has done some scummy things in the past (bricking units to prevent resale or refurbishment, deactivating old hardware, etc), but they operate in a very hard business sector against giants with monopolistic loss leaders, and this is a really cool open source release. I'm not aiming to buy more Sonos equipment, but I like them a little more now.
- hobofan 6y agoTract supports ONNX models, which you can export from pytorch. See nnsplit[0] as an example for a project that trains with pytorch and serves the model via tract-onnx. [0]: https://github.com/bminixhofer/nnsplit https://github.com/bminixhofer/nnsplit
- narrationbox 6y agoTract looks incredible, I am surprised that it can support Wavenet on the Raspberry Pi Zero.
- imglorp 6y agoWe were unable to get Tract to work at $job but there's another project, I think called onnxruntime-rs that we did get working with our models.
- aldanor 6y agoYou can also export them from LightGBM and XGBoost (see sklearn-onnx) for forests and tract will handle them! // well, almost... I need to finally find some time and finish my tract PR :)
- woodson 6y agoI believe it also supports what it calls "pulse" models converted/imported from Kaldi for low-latency ASR/keyword spotting (though this may have changed, I haven't checked in a while).
- deleted 6y ago[deleted]