18 ms·
Even with large context windows, this technique is useful. I have found breaking down a problem into “map reduce” does much better than stuffing it into a huge
by ec109685 3y ago
Even with large context windows, this technique is useful. I have found breaking down a problem into “map reduce” does much better than stuffing it into a huge 32k context window and asking it solve it in one shot.
- TuringNYC 3y agoIt would require careful setup, but one thing that might be the case is losing light mentions across many documents and keeping heavy mentions clustered in one document. With the summary-of-summaries approach, I think dense clusters in one document vs consistent mentions in many documents wouldnt get the same treatment.