3 ms·
One thread will (probably) be merged into the other, but GPT-2 was an extremely popular OpenAI project that generated long, realistic-sounding text/articles if
by judge2020 6y ago
One thread will (probably) be merged into the other, but GPT-2 was an extremely popular OpenAI project that generated long, realistic-sounding text/articles if you gave it a simple starting sentence or topic sentence. GPT-3 is an iteration on that, so it's likely a huge improvement.
- anoncareer0212 6y agoIt doesn't sound like it's an improvement at all, but instead requires less training data to produce worse results?
- Reelin 6y agoThis is a massive improvement to the extent that previously you had to retrain (ie update) the stock model on a specialized dataset to get good results for a particular task.
- freeone3000 6y agoMUCH less training for SLIGHTLY worse results. It's a huge benefit to be able to make this trade-off.
- drusepth 6y agoIs the reverse also true? If you have the training data necessary for "good" results on GPT-2, is it generally correct to assume that it would provide better results on your task than GPT-3?
- freeone3000 6y agoIf you can answer this question without running both models over the data set, you've got a very good paper on your hands.