4 ms·
What about for 16 GB VRAM? Is Qwen3.5-9B worthwhile?
by dlcarrier 6mo ago
What about for 16 GB VRAM? Is Qwen3.5-9B worthwhile?
- wren6991 6mo agoFor 16 GB I would look into running Qwen3.6-35B-A3B (MoE) with some layers offloaded to CPU.
loading thread…