4 ms·
Summarize along the way, instead of attempting to use the context like a database. Or look into RAG. Or use Gemini-1.5's 1 million token window.
by korkybuchek 2y ago
Summarize along the way, instead of attempting to use the context like a database. Or look into RAG. Or use Gemini-1.5's 1 million token window.
- jMyles 2y agoThose are great tips. The RAG thing looks doable. Is there a pre-fab solution, or do I need to use one of the APIs for the big-box providers? My concern is: although it looks relatively easy to implement, I'm not sure I want to build a whole interface for it. I wish Cursor exposed, eg, this: https://github.com/anthropics/anthropic-cookbook/blob/main/skills/contextual-embeddings/guide.ipynb https://github.com/anthropics/anthropic-cookbook/blob/main/s...
- korkybuchek 2y agoIt's a bear to implement well. I'd start with Gemini and see how far that context window can take you. Then I'd work on summarizing fragments of earlier conversations down to key points to include in the broader conversation. Then I probably still wouldn't try to implement RAG unless time was not an issue.
- jMyles 2y agoGotcha; thanks for the tip. Gemini seems to be much, much worse at the interpersonal dynamics that are important to us. It can't seem to keep track of who has what life experiences and how they might be relevant to our problem-solving, where Claude does this rather well. I'm working with Claude now to create a summary capsule.