You can train GPT-J, etc on your own dataset but that won't get you the same results unless you train it on almost all the high quality content on the internet

You can train GPT-J, etc on your own dataset but that won't get you the same results unless you train it on almost all the high quality content on the internet and spend millions of dollars on gpus.