2 ms·
>what it decides it needs This is what I am suggesting: relying on the model to decide what it needs is maybe not the best use of the available context. It mig
by zoogeny 1y ago
>what it decides it needs
This is what I am suggesting: relying on the model to decide what it needs is maybe not the best use of the available context. It might be better for us to give it the information we are certain it will need.
- kiitos 1y agoI'm talking about situations where the user wants to ask questions about data that's many orders of magnitude larger than what can be included in any LLM request context. I just provide access to the data (via MCP server, RAG server, whatever) and my question/prompt, it's the LLM's responsibility to do everything else.