See also GenRead[0]: > A common approach for knowledge-intensive tasks is to employ a retrieve-then-read pipeline that first retrieves a handful of relevant co

See also GenRead[0]: > A common approach for knowledge-intensive tasks is to employ a retrieve-then-read pipeline that first retrieves a handful of relevant contextual documents from an external corpus such as Wikipedia and then predicts an answer conditioned on the retrieved documents. In this paper, we present a novel perspective for solving knowledge-intensive tasks by replacing document retrievers with large language model generators. i.e. generating some bullshit citation will improve the accuracy of the completion -- even outperforming actual retrieval! (they find, at least) Also see the fact that chain-of-thought prompting works even if the logic steps are bullshit. GPT-3 is very funny. [0] https://arxiv.org/abs/2209.10063 https://arxiv.org/abs/2209.10063