I was imagining using a separate model just for providing tags as they are very accurate. It would theoretically give gpt-2 useful data. GPT-2 has not (yet) be

I was imagining using a separate model just for providing tags as they are very accurate. It would theoretically give gpt-2 useful data. GPT-2 has not (yet) been trained to predict POS tags to my knowledge, nor BERT, or ernie 2 or xlnet has, but I think they have great potential to improve POS accuracy.