Yep totally. You can forget about training Tranformer-based NLP models from scratch at home, sadly... however you can choose a pre-trained model and fine-tune i

Yep totally. You can forget about training Tranformer-based NLP models from scratch at home, sadly... however you can choose a pre-trained model and fine-tune it with your annotated data. Serving the models for inference is different, you can definitely perform inference on your local machine for most of the existing NLP models, even Transformer-based models. But GPT-J and GPT-Neo might be exceptions though as they require tons of RAM. Also, even if you can perform inference at home, you might not have great perfs without NVIDIA GPUs dedicated to AI.