3 ms·
We already know LLMs are good at summarizing. Question is how good they are are retaining minute details from extremely long context, say 200k tokens. That’s
by jafitc 3y ago
We already know LLMs are good at summarizing.
Question is how good they are are retaining minute details from extremely long context, say 200k tokens.
That’s the frontier Claude and now GPT-4 Turbo are pushing
- basch 3y agoI guess I’m proposing a new compression, new substitutions, the llm inventing new words to compress common ideas. A bytecode if you will. Compiling the context down.