It's really striking that the prompt is just a variation of "using the following text as reference material: <paste text of relevant document here>, answer the

It's really striking that the prompt is just a variation of "using the following text as reference material: <paste text of relevant document here>, answer the following question: <paste question here>". It's so simple it almost makes you wonder if this "should" work, but apparently it does so that's nice. On the other hand, this approach does struggle if the chosen reference is not actually the one you want, or if the correct answer is spread over some combination of many different documents. You could add more reference documents to the prompt, but intuitively that doesn't scale with many and/or large documents.