4 ms·
Seconded, I wish for a way to work with ML models using native code rather than through some Python scripting interface. I believe TensorFlow is there with C++,
by LoganDark 4y ago
Seconded, I wish for a way to work with ML models using native code rather than through some Python scripting interface. I believe TensorFlow is there with C++, but it works only with C++ and not through FFI.
- ggerganov 4y agoIt's one of the reasons I recently ported the Whisper model to plain C/C++. You just clone the repo, run `make [model]` and you are ready to go. No Python, no frameworks, no packages - plain and simple. https://github.com/ggerganov/whisper.cpp https://github.com/ggerganov/whisper.cpp
- microtonal 4y agoPyTorch has libtorch as its purely native library. There are also Rust bindings for libtorch: https://github.com/LaurentMazare/tch-rs https://github.com/LaurentMazare/tch-rs I used this in the past to make a transformer-based syntax annotator. Fully in Rust, no Python required: https://github.com/tensordot/syntaxdot https://github.com/tensordot/syntaxdot
- 0x008 4y agoIf you are okay with using nvidia-ecosystem, check out tensor rt.
- c7DJTLrn 4y agoIt would increase my interest in experimenting with these models 1000% at the least. I really can't be bothered to spend hours fucking around with pip/pipenv/poetry/virtualenv/anaconda/god knows what other flavour of the month package manager is in use. I just want to clone it and run it, like a Go project. I don't want to download some files from a random website and move them into a special directory in the repo only created after running a script with special flags or some bullshit. I want to clone and run.