3 ms·
I assume you mean outside the boundaries of context window size or token thresholds right?
by uberman 8mo ago
I assume you mean outside the boundaries of context window size or token thresholds right?
- boh144 8mo agoBoth in a way. I'd say it gets worse outside the context window it seems to get worse due to compression and loss of detail. Even in a single context window it's hard to keep ideas and branches clean and remember important insights.