Context windows for LLM inference are limited. You can't just throw everything into it -- it won't all fit, and larger amounts of context are slower and more ex

Context windows for LLM inference are limited. You can't just throw everything into it -- it won't all fit, and larger amounts of context are slower and more expensive. So it's important to have a carefully curated set of well-formatted documents to work with.