4 ms·
Does anyone know of a similar idea for neural networks? As far as I can tell, you need the entire framework (which requires a heavy, 1.5 GB docker image) to app
by isolli 8y ago
Does anyone know of a similar idea for neural networks? As far as I can tell, you need the entire framework (which requires a heavy, 1.5 GB docker image) to apply a trained model, even though in theory you only need matrix multiplication and a few activation functions.
Related: https://onnx.ai/ https://onnx.ai/
- ctchocula 8y agoA similar idea but for neural networks is by using TVM [1]. It's built on top of Halide and LLVM. I haven't tried it myself, but it seems to support deployment to many backends. [1] https://docs.tvm.ai/deploy/index.html https://docs.tvm.ai/deploy/index.html
- elephantum 8y agoThere’s a project that compiles ONNX models: https://onnc.ai https://onnc.ai
- pplonski86 8y agoI wrote keras2cpp https://github.com/pplonski/keras2cpp https://github.com/pplonski/keras2cpp It transforms keras + theano models into pure C++, no additional packages. It is not using GPU.
- v_lisivka 8y agoTry Yolo: https://pjreddie.com/darknet/yolo/ https://pjreddie.com/darknet/yolo/ . It's written in C.