3 ms·
It doesn't sound like it's an improvement at all, but instead requires less training data to produce worse results?
by anoncareer0212 6y ago
It doesn't sound like it's an improvement at all, but instead requires less training data to produce worse results?
- Reelin 6y agoThis is a massive improvement to the extent that previously you had to retrain (ie update) the stock model on a specialized dataset to get good results for a particular task.
- freeone3000 6y agoMUCH less training for SLIGHTLY worse results. It's a huge benefit to be able to make this trade-off.
- drusepth 6y agoIs the reverse also true? If you have the training data necessary for "good" results on GPT-2, is it generally correct to assume that it would provide better results on your task than GPT-3?
- freeone3000 6y agoIf you can answer this question without running both models over the data set, you've got a very good paper on your hands.