I have a little paper on this, sorry for the plug :-D http://ingomarquart.de/index.php/research/2-the-semantics-of-leadership-joint-with-nghi-truong-and-matthe

I have a little paper on this, sorry for the plug :-D http://ingomarquart.de/index.php/research/2-the-semantics-of-leadership-joint-with-nghi-truong-and-matthew-bothner http://ingomarquart.de/index.php/research/2-the-semantics-of... uses BERT, but GPT2 would work as well. I am working on making this a python package and a technical article on the method which works really great. One example is that I can use clustering to distinguish out syntactic information and then get a purely semantic ego graph (as used in the paper for roles).