3 ms·
I'm new to RAG and have a question: how do you get all the numbers into the context window? Does the RAG part look up just the needed number? I think that Ge
by MikeTheGreat 1y ago
I'm new to RAG and have a question: how do you get all the numbers into the context window?
Does the RAG part look up just the needed number?
I think that Gemini has a million token window (yes?) - do you have access to a model with a larger window?
Regardless, I find your ideas intriguing and wish to subscribe to your Substack.
- turnsout 1y agoWe have an agentic system that looks up the context size, and then summarizes the even/odd table if necessary. We lose a little bit of accuracy, but now we can handle any model. Be sure to like & subscribe!