4 ms·
Fellow readers, would anyone please mind sharing their current experiences? qwen3.6-35b-a3b for local inference, GitHub Copilot Chat was previously worth it, an
by bellowsgulch 2mo ago
Fellow readers, would anyone please mind sharing their current experiences? qwen3.6-35b-a3b for local inference, GitHub Copilot Chat was previously worth it, and no longer is, tried OpenRouter and still read through their rankings to see what the industry is actively using, wholesale migrated to OpenCode Zen/Go.
Does this mirror what other people have been experiencing in waves?
- Roark66 2mo agoI've been using Qwen3.6 models locally for a couple of weeks. Both the A3B moe and the dense variant. The moe works well in Librechat combined with my local search/Web retrieval system. All components use open source projects such as SearXNG, Crawl4AI, MetaMCP, Jina rerank, but all needed quite a bit of coding to work nicely together. I get 140 tok/s on short prompts on an rtx3090 on the qwen3.6 moe which makes is easily 4x the speed of Chatgpt or Claude doing Web research. But it is a much simpler model. It is only good for simple queries, usually I search for cheapest product in stock in my country available online and stuff like that. I use the dense model for planning and such, but on its own it is much inferior to for example opus. It needs careful pipelines that check facts and such and in such harness it can be used for mamy tasks.