Summarization is a fundamental capability these models develop early on. Remember that one of the things that impressed people about GPT-2 was the discovery tha

Summarization is a fundamental capability these models develop early on. Remember that one of the things that impressed people about GPT-2 was the discovery that you could prompt them for summaries just by appending "tl;dr" to some text? The issue was always quality, length of summarized text, and control of exactly what kind of summary.