3 ms·
Any reason this is based on GPT-2 instead of GPT-3? (Given that the world's been going nuts over 3, I'd imagine its probabilistic model is significantly better)
by TheRealPomax 6y ago
Any reason this is based on GPT-2 instead of GPT-3? (Given that the world's been going nuts over 3, I'd imagine its probabilistic model is significantly better)
- OkGoDoIt 6y agoProbably because there’s no way to get access to or run GPT-3 unless you’re super well-connected and lucky, to be allowed to pay OpenAI for the privilege? GPT-3 is exciting in that it shows what’s possible if we push the transformer architecture farther, but it’s not really practical for much when it’s so walled off like it currently is