4 ms·
I'm running Qwen3.6:27b Q4 KM on a 4090 and similarly fast CPU and I think 32GB of RAM. Make sure the context window is set to be big enough otherwise the conve
by briga 5mo ago
I'm running Qwen3.6:27b Q4 KM on a 4090 and similarly fast CPU and I think 32GB of RAM. Make sure the context window is set to be big enough otherwise the conversation will keep compacting. No special MCP tools set up yet. Qwen is able to do web search out-of-the-box although I think it is getting blocked by anti-bot firewalls--I still need to figure out if I can fix that.
- SeriousM 5mo agoThis is the repo: https://huggingface.co/pbhappliedsystems/qwen3.6-27B-gguf-Q4-K-M https://huggingface.co/pbhappliedsystems/qwen3.6-27B-gguf-Q4...