4 ms·
Have you used this method yourself for long workflows and with contexts approaching 1 million tokens? It doesn't work very well. LLM context is nearly half unus
by Schlagbohrer 3mo ago
Have you used this method yourself for long workflows and with contexts approaching 1 million tokens? It doesn't work very well. LLM context is nearly half unusable.
- noosphr 3mo agoI've found that model performance starts substantially degrading after 10%.
- Schlagbohrer 3mo agoI see with qwen3.6-35B running in Pi that it gets stuck in loops when the 262k context gets more than 30% full.
- edg5000 3mo agoI always let GPT 5.5/5.6 sol reach compatction. I'm only offered a 258K window, but I think once they release 1M to normal plan users, it will be usable across the whole 1M. At least with Opus I could use the whole 1M. I'd argue that the more context I use, the better performance gets. It has more info already available. I don't notice degradation.