3 ms·
How will a more powerful model be a substitute for RAG, which is usually used with private data that won’t be present in any training dataset?
by Xenoamorphous 3y ago
How will a more powerful model be a substitute for RAG, which is usually used with private data that won’t be present in any training dataset?
- ldjkfkdsjnv 3y agoI just think that the capability of the model could radically change, such that however you structured your RAG pipeline, might need to be rewritten. More general problems could be solved by the model, that you were solving with some complicated contraption of prompts.
- kergonath 3y agoOne of the idea is to just stuff all the documents in the prompt, which still keeps them private but avoids having to faff around with chunking, embedding, and vector stores. That’s not really the end of RAG as a concept, but it would change all the current tooling and infrastructure we built for it. I don’t think RAG is going away, at least not because of this. But I expect new techniques to become available fairly regularly.