2 ms·
Proposal: Lower the resolution of the context window for distant historical tokens. Summarize most important concepts, drop out the rest. Do not try to assess e
by the_optimist 2y ago
Proposal: Lower the resolution of the context window for distant historical tokens. Summarize most important concepts, drop out the rest. Do not try to assess every single token.