Actually using this class (larger transformer based language models) of models to generate text is to me the least interesting use case. They can also all be a

Actually using this class (larger transformer based language models) of models to generate text is to me the least interesting use case. They can also all be adapted and fine tuned for other tasks in content classification, search, discovery etc. Think facnial recognition for topics. Want to mine a whole social network for anywhere people are talking about _______ even indirectly with very low false negative rate? You want to fine tune a transformer model. Bert tends to get used for this more because it is freely available, established and not too expensive to fine tune but i suspect this is what microsoft licensing gpt-3 is all about.