3 ms·
From the results in Figure 5, it appears that this would only be advantageous for long long contexts. In particular, it is slower when used with <30k token con
by djoldman 1y ago
From the results in Figure 5, it appears that this would only be advantageous for long long contexts.
In particular, it is slower when used with <30k token context.
- snowfield 1y agoHigh context is pretty normal these days though, as you keep interfacing with the llms the context window just grows. And with mcps and RAG is trivial to get 30k contexts++ in every query
- seg_lol 1y agoThe system prompt for coding agents is already in the 30k range.
- deleted 1y ago[deleted]