Nowadays you can find much better free and opensource models than GPT-2. The only point of keeping using GPT-2 is to compare it in benchmarks against newer mod

Nowadays you can find much better free and opensource models than GPT-2. The only point of keeping using GPT-2 is to compare it in benchmarks against newer models. The better alternatives are often bigger in size but you will find better models that are also smaller or similarly sized. However, a rule of thumb is the bigger the model is, the better the quality of the output will be. So you need to aim for the best model that fits on your hardware. Personally I wouldn't go below 6B parameters server side anymore. When buying new hardware, I would aim for something that can run at least 30B, or 13B if you are on a budget. The benchmarks aren't perfect but here is a leaderboard about the open large langage models: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb... You can see that GPT-2 is at the bottom.