That's great if it works, but I have always been extremely skeptical of relying on chunks as a means of retrieving information. Considering chunks misses the su

That's great if it works, but I have always been extremely skeptical of relying on chunks as a means of retrieving information. Considering chunks misses the surrounding context and nuanced conditions that qualify the chunk's usage. I believe it is better to use the entire document in large context instead, then have the LLM summarize its relevance into an accurate title and blurb. When retrieving, filter and match over the titles and blurbs, then again give the LLM the entire text.