3 ms·
first, this is amazing! second, how does one increase the context window without requiring obscene amounts of RAM? we're really hitting the limitations of the
by buyucu 2y ago
first, this is amazing!
second, how does one increase the context window without requiring obscene amounts of RAM? we're really hitting the limitations of the transformer architecture's quadratic scaling...
- 35mm 2y agoChain of agents seems to be a promising approach for splitting up tasks into smaller parts and then synthesising the results[1] [1] https://research.google/blog/chain-of-agents-large-language-models-collaborating-on-long-context-tasks/ https://research.google/blog/chain-of-agents-large-language-...