I just tried messing around with the chunk size until the results looked best to my eye. One important thing to note is that each chunk includes a portion of th

I just tried messing around with the chunk size until the results looked best to my eye. One important thing to note is that each chunk includes a portion of the previous chunk as context. But yes, it’s not going to have context that spans the entire document. For that you would need a final step that takes the entire output. One thing I learned from this is that you can’t ask too much at once from these value tier models. If you keep your requests modest and focused, they do really well. When you try to cram too much complexity and too many rules/requests at once, they start messing up and leaving stuff out and hallucinating.