3 ms·
It takes a bit of effort to setup and train a proper GPT-2 model, especially if you are not familiar with GPU drivers and python environment. Also don't try to
by paradite 2y ago
It takes a bit of effort to setup and train a proper GPT-2 model, especially if you are not familiar with GPU drivers and python environment.
Also don't try to train GPT-2 on your own machine as it takes days, even with a good gaming GPU.
If you are interested in trying it out, but don't have the right GPU or OS, you can check out the guide I wrote on how I did it on Azure with T4 GPU instance:
https://16x.engineer/2023/12/29/nanoGPT-azure-T4-ubuntu-guide.html https://16x.engineer/2023/12/29/nanoGPT-azure-T4-ubuntu-guid...
- alok-g 2y agoThanks a lot for sharing this. How much does the net cost come out to for a run? (Am not a startup.) Also, any smaller datasets you would recommend that still demonstrate some useful capability? Thanks.
- paradite 2y agoUpdate: added result section to my post with more details: https://16x.engineer/2023/12/29/nanoGPT-azure-T4-ubuntu-guide.html#results https://16x.engineer/2023/12/29/nanoGPT-azure-T4-ubuntu-guid... I don't think it can go any smaller and demonstrate its capabilities. Even GPT-2 is mostly generating nonsensical sentences that resembles English. You might be looking at ngram or markov model for simpler NLP capabilities.
- alok-g 2y agoThanks!