3 ms·
How do you think it could be used there? A separate model just for providing tags, or the same model but trained to predict tags as well?
by p1esk 7y ago
How do you think it could be used there? A separate model just for providing tags, or the same model but trained to predict tags as well?
- The_rationalist 7y agoI was imagining using a separate model just for providing tags as they are very accurate. It would theoretically give gpt-2 useful data. GPT-2 has not (yet) been trained to predict POS tags to my knowledge, nor BERT, or ernie 2 or xlnet has, but I think they have great potential to improve POS accuracy.