3 ms·
Are you suggesting adding another step after retrieval, to add the surrounding context before submitting it to the LLM?
by esafak 3y ago
Are you suggesting adding another step after retrieval, to add the surrounding context before submitting it to the LLM?
- alchemist1e9 3y agoYes absolutely. Often to understand the context of a topic it requires more than just the specific paragraph it is discussed and the LLMs are actually perfectly capable of understanding fairly complex concepts if provide the raw material properly.
- lmeyerov 3y agoThis seems similar to recursive summary indexing and then a choice of which linked chunks to load upon a match There are a lot of 'policy' choices here, so I've been curious how to automatically decide. The KG, GNN, and IR literature seems to have a lot of techniques relating to this, so been very non-obvious to me