2 ms·
Qwen3.6 supports 266k context out of the box. Try using q8 kv cache to enable more of it.
by nixon_why69 6mo ago
Qwen3.6 supports 266k context out of the box. Try using q8 kv cache to enable more of it.
- gchamonlive 6mo agoI limited it to 64k expecting 24GB vram to not be enough to make use of the entire context window, but I'll try with other's suggestions.