4 ms·
Even for small use cases with less than a million tokens RAG is often the better approach because of the time and money huge context windows consume: A minute (
by singularity2001 3y ago
Even for small use cases with less than a million tokens RAG is often the better approach because of the time and money huge context windows consume: A minute (!!) and a dollar (?) per query in the Gemini demo