Alas, "summarization" is a crapshoot. It sometimes summarizes essential facts out of the original text. I think it's due to limits on output tokens. And chunkin

Alas, "summarization" is a crapshoot. It sometimes summarizes essential facts out of the original text. I think it's due to limits on output tokens. And chunking cannot solve this because you cannot summarize well if you don't take in the whole thing. Aggregating summarized chunks doesn't produce good results. It works very very well on Amazon reviews, though, because these are small and thin.