3 ms·
I haven't look into at all myself, but he also said: >We do provide training code that should work out of the box for gpt2 117M/345M https://twitter.com/TheRe
by JonathanFly 7y ago
I haven't look into at all myself, but he also said:
>We do provide training code that should work out of the box for gpt2 117M/345M
https://twitter.com/TheRealRPuri/status/1161319745259393024 https://twitter.com/TheRealRPuri/status/1161319745259393024
- p1esk 7y agoIt would take forever (or $$$) to train even 117M model from scratch.
- JonathanFly 7y agoI read that meaning you can start with the actual pre-trained GPT-2 models but I never got an answer when I specifically asked if that was the case.