3 ms·
A bit of personal anecdote -- at work, we have thousands of "Briefings" which are hour-long (sometimes day-long) in-person panels. We've successfully summarized
by TuringNYC 3y ago
A bit of personal anecdote -- at work, we have thousands of "Briefings" which are hour-long (sometimes day-long) in-person panels. We've successfully summarized each and every briefing. The messy transcripts are well summarized into five paragraph of text.
More topical, we also 1:many categorized each briefing into topics and sub-topics with topics ending up with several dozen briefings and sub-topics of a dozen briefings. For this we summarized the subset of associated summaries and tested this comprehensively, and had great results with LLMs.
I was originally skeptical this would work, but it worked beautifully. Given a sufficiently large context window, we would not have done so, but thankfully this was not a problem.
- ec109685 3y agoEven with large context windows, this technique is useful. I have found breaking down a problem into “map reduce” does much better than stuffing it into a huge 32k context window and asking it solve it in one shot.
- TuringNYC 3y agoIt would require careful setup, but one thing that might be the case is losing light mentions across many documents and keeping heavy mentions clustered in one document. With the summary-of-summaries approach, I think dense clusters in one document vs consistent mentions in many documents wouldnt get the same treatment.