3 ms·
To clarify, > Port of Hugging Face's Transformers library, using the tch-rs crate and pre-processing from rust-tokenizers. > tch-rs: Rust bindings for the C++
by MuffinFlavored 4y ago
To clarify,
> Port of Hugging Face's Transformers library, using the tch-rs crate and pre-processing from rust-tokenizers.
> tch-rs: Rust bindings for the C++ api of PyTorch.
Which "backend" does this end up using on Apple Silicon, MPS (Metal Performance Shaders) or OpenCL?
https://pytorch.org/docs/stable/notes/mps.html https://pytorch.org/docs/stable/notes/mps.html
I'm going to guess MPS?
- smoldesu 4y agoWhatever your Pytorch install is designed to accelerate. I've got Ampere-accelerated Pytorch running it on my ARM server, I assume MPS is used on compatible systems.