I am speaking of the OPs implementation of RAG, not in general. The retrieval part can be expensive if an LLM is used to confirm that it is sufficient, and if

I am speaking of the OPs implementation of RAG, not in general. The retrieval part can be expensive if an LLM is used to confirm that it is sufficient, and if it's decided to continue searching if it's not. OpenAIs retrieval is a perfect example. It works, but it's very expensive