4 ms·
It's incredibly satisfying to reproduce these papers. I now make Rust versions of the most interesting projects. And try to make low-latency inference pipelines
by rozgo 6y ago
It's incredibly satisfying to reproduce these papers. I now make Rust versions of the most interesting projects. And try to make low-latency inference pipelines for those that show potential for real-time use. Some are sketched out here: https://github.com/Simbotic/SimboticTorch https://github.com/Simbotic/SimboticTorch
The bulk of the work to get real-time working is to move more of pipeline to GPU. Mostly things handled by numpy and some image/video transformations.
- qchris 6y agoThat's awesome! If you're interested, there's a group working on machine learning in Rust, including some working on doing GPU pipelines for it at https://github.com/rust-ml/wg https://github.com/rust-ml/wg . I'm not sure if any of the work being done right now is directly applicable to any of the projects that you're reproducing, but it might be worth a look!
- rozgo 6y agoOh, I'm interested. Thanks for letting me know. Would love to contribute.
- BracketMaster 6y agoThis truly is amazing. I've noticed that GPU does help a lot with inference. It would be nice if it were easier to make projects like these mobile. Google and Apple have SDKs for running nets on phones, but its a shame its so hard to do things like this on the Raspberry pi...
- Miraste 6y agoTensorflow Lite runs on Raspberry Pis. It's even in the official docs: https://www.tensorflow.org/lite/guide/build_rpi https://www.tensorflow.org/lite/guide/build_rpi