4 ms·
could you elaborate on your opinion's on RAGs? my impression is RAGs are the industry's magic bullet to all the downsides and challenges posed by LLMs.
by 2-3-7-43-1807 2y ago
could you elaborate on your opinion's on RAGs? my impression is RAGs are the industry's magic bullet to all the downsides and challenges posed by LLMs.
- ekianjo 2y agoSure. RAG is an effective tool to make up for limited context lengths and ensure you have relevant information to answer specific questions. But where it is not a magic bullet is that the accuracy that you get from a RAG is by default very low. You can verify this by building a set of questions and related ground truths and checking how much your RAG can get to the truth or close enough. A vanilla RAG system without much added work will hover around 50% or less accuracy, and even lower if you focus only on complex questions that require quite a few different chunks to get to the real answer. Overall, you don't know how good your RAG is until you test it extensively.