Yes, of course I used an LLM for the response, but not just any LLM. I used an instance of ChatRAG that has all the ChatRAG documentation built into it. I’m a s

Yes, of course I used an LLM for the response, but not just any LLM. I used an instance of ChatRAG that has all the ChatRAG documentation built into it. I’m a solo developer trying to build software, do the marketing, handle customer support, and also be a dad and a husband. Of course I’m going to use my own product to help me out. This is precisely why I know ChatRAG is good, I use it myself daily. That said, let me clarify the points you raised. On "freshly curated each turn rather than accumulated": this is actually the correct behavior, though I can see how the phrasing was confusing. The key is that conversation history and RAG context are two different things. The full conversation history... all previous user and assistant message... is always passed to the model without truncation. But the retrieved document chunkz are a separate layer. Those get requeried based on the current message and injected into the system prompt fresh each turn. Previous RAG results dont accumulate, they are replaced with whatever is most relevant to the current query. Why this design? Say you ask about 'Q3 revenue' and then follow up with 'What about employe benefits?' If the system accumulated chunks, you'd have Q3 revenue data polluting the context when you're now asking about something completely different. Fresh retrieval ensures the context stays relevant to what you're actually asking about right now. On tool-based retrieval: the system does have this through MCP integration. Query classification detects when tools are needed (Gmail, Calendar, Drive, Zapier, etc.) and routes accordingly. The model receives both the RAG context and access to tools, so it can use document knowledge and execute external actions within the same response when needed Let me know if you have any other questions. I’ll be more than happy to answer, with the help of my ChatRAG instance, any other doubts you may have !