I’ve been writing all of our transformer implementations in Rust using the Candle crate and it’s been great. While dealing with CUDA and GPUs on servers is nev

I’ve been writing all of our transformer implementations in Rust using the Candle crate and it’s been great. While dealing with CUDA and GPUs on servers is never a joy, deploying fully contained Rust binaries instead of a morass of python scripts has improved the situation for me significantly. Getting Samurai running on Candle shouldn’t be that large of an undertaking. I believe there’s already a SAM implementation.