2 ms·
Does llama.cpp support Qwen3.5 yet? When I tried it before, it failed saying "qwen35moe" is an unsupported architecture.
by cpburns2009 8mo ago
Does llama.cpp support Qwen3.5 yet? When I tried it before, it failed saying "qwen35moe" is an unsupported architecture.
- reactordev 8mo agoYou would need the Dynamic 2.0 GGUF as discussed in the article. But mmmmmm, Q8_K_XL looks mighty nice.
- hnfong 8mo agoYes, but make sure you grab the latest llama.cpp release New model archs usually involve code changes.
- cpburns2009 8mo agoAwesome! It looks like the llama.cpp-hip AUR was updated today to b8179, and it works.
- sowbug 8mo agoIf you're running Ollama, you'll have to wait a little longer for its embedded version of llama.cpp to catch up. It can be a couple days or weeks behind.