2 ms·
If you load something into the LLM context, there's a non-zero chance that it'll be referenced. How are you chunking things? Can you chunk it in a way that sid
by lunarcave 2y ago
If you load something into the LLM context, there's a non-zero chance that it'll be referenced.
How are you chunking things? Can you chunk it in a way that sidesteps the problem?
It's kind of hard to give generic advice without knowing your PDF structure.
But generally, you have two ways forward:
- Optimise chunking to be more context aware of the chunked content
- Allow the LLM to refer to adjacent chunks via some kind of a pointer