3 ms·
I'm talking about situations where the user wants to ask questions about data that's many orders of magnitude larger than what can be included in any LLM reques
by kiitos 1y ago
I'm talking about situations where the user wants to ask questions about data that's many orders of magnitude larger than what can be included in any LLM request context. I just provide access to the data (via MCP server, RAG server, whatever) and my question/prompt, it's the LLM's responsibility to do everything else.