4 ms·
> Although this task serves as a nice proof-of-concept, we started looking at more difficult datasets where reading the entire document is necessary to produce
by asib 10y ago
> Although this task serves as a nice proof-of-concept, we started looking at more difficult datasets where reading the entire document is necessary to produce good summaries. In those tasks training from scratch with this model architecture does not do as well as some other techniques we’re researching, but it serves as a baseline.
That would suggest that this method doesn't work well for long documents.