3 ms·
they already use internally a POS tagger and a dependency parser. Interesting. Where did you see that?
by p1esk 7y ago
they already use internally a POS tagger and a dependency parser.
Interesting. Where did you see that?
- The_rationalist 7y agoWell it was just a belief. I may be wrong. I asked them by curiosity https://github.com/openai/gpt-2/issues/168 https://github.com/openai/gpt-2/issues/168 So we will know.
- p1esk 7y agoHow do you think it could be used there? A separate model just for providing tags, or the same model but trained to predict tags as well?
- The_rationalist 7y agoI was imagining using a separate model just for providing tags as they are very accurate. It would theoretically give gpt-2 useful data. GPT-2 has not (yet) been trained to predict POS tags to my knowledge, nor BERT, or ernie 2 or xlnet has, but I think they have great potential to improve POS accuracy.