4 ms·
Thank you for this data. I'm no machine learning engineer, but learning some NLP and was wondering what kind of computer would get to run state-at-the-art model
by happy_path 5y ago
Thank you for this data. I'm no machine learning engineer, but learning some NLP and was wondering what kind of computer would get to run state-at-the-art models.
I assume the hardware requirements for training are massive and impractical for home-use, isn't it?
- juliensalinas 5y agoYep totally. You can forget about training Tranformer-based NLP models from scratch at home, sadly... however you can choose a pre-trained model and fine-tune it with your annotated data. Serving the models for inference is different, you can definitely perform inference on your local machine for most of the existing NLP models, even Transformer-based models. But GPT-J and GPT-Neo might be exceptions though as they require tons of RAM. Also, even if you can perform inference at home, you might not have great perfs without NVIDIA GPUs dedicated to AI.