3 ms·
How long did it take to train this GPT-2 based model?
by Yajirobe 5y ago
How long did it take to train this GPT-2 based model?
- turtlesoup 5y agoIt's a refinement of a lightweight version of GPT-2 by Hugging Face -- https://huggingface.co/transformers/model_doc/gpt2.html https://huggingface.co/transformers/model_doc/gpt2.html. I don't recall exact numbers, but once I had the structure of the problem right (i.e. sequencing words, part of speech and definitions) it was around 12 hours on my old 1080 TI.