3 ms·
> Limit additional context in retrieval-augmented generation (RAG): When providing additional context or documents, include only the most relevant information t
by vercantez 2y ago
> Limit additional context in retrieval-augmented generation (RAG): When providing additional context or documents, include only the most relevant information to prevent the model from overcomplicating its response.
This databricks blog/paper seemingly contradicts this:
> OpenAI o1 models show a consistent improvement over Anthropic and Google models on our long context RAG Benchmark up to 128k tokens.
https://www.databricks.com/blog/long-context-rag-capabilities-openai-o1-and-google-gemini https://www.databricks.com/blog/long-context-rag-capabilitie...