3 ms·
Transformers v5 GA is out
We've finally released the first stable release of transformers v5 in general audience, it comes with many goodies:
- Performance especially for Mixture-of-Experts (6x-11x speedups)
- No more slow/fast tokenizers: way simpler API, explicit backends, better performance
- dynamic weight loading: way faster, MoE now working with quants, tp, PEFT..
We have a migration guide on the main branch; please take a look at it in case you run into issues, we also have documented everything in release notes. We appreciate the feedbacks, so feel free to create issues if you have any!
- tiernano 8mo agolinks?
- unofficialmerve 8mo agohere's the release notes: https://github.com/huggingface/transformers/releases/tag/v5.0.0 https://github.com/huggingface/transformers/releases/tag/v5....
- eoskx 8mo agoCongrats on the v5 release! Glad to see the tokenizer rewrite.