3 ms·
New to the space — I have been using HF for both training and inference. Do you have recommendations for a different framework for training? Accelerate seems f
by LatticeAnimal 3y ago
New to the space — I have been using HF for both training and inference.
Do you have recommendations for a different framework for training? Accelerate seems fantastic for scaling up once I need to
- omneity 3y agoHF has been pretty good for training in my experience. Both accelerate, deepspeed and other improvements are available and the ecosystem is vibrant. One thing you might want to look into is to write your own training loop rather than using Autotrainer, but that's if you want to get you hands dirty and get finer control over how you call layers, your loss function etc. Inference is where it falls short really, and solutions like vLLM are much much faster.