Sure. RAG is an effective tool to make up for limited context lengths and ensure you have relevant information to answer specific questions. But where it is not

Sure. RAG is an effective tool to make up for limited context lengths and ensure you have relevant information to answer specific questions. But where it is not a magic bullet is that the accuracy that you get from a RAG is by default very low. You can verify this by building a set of questions and related ground truths and checking how much your RAG can get to the truth or close enough. A vanilla RAG system without much added work will hover around 50% or less accuracy, and even lower if you focus only on complex questions that require quite a few different chunks to get to the real answer. Overall, you don't know how good your RAG is until you test it extensively.