3 ms·

> when unsloth has quants available https://huggingface.co/unsloth/Qwen3.6-27B-GGUF https://huggingface.co/unsloth/Qwen3.6-27B-GGUF

• verdverm 6mo ago
  That was quick (compared to the 1T Kimi-2.6, not surprising)
  • danielhanchen 6mo ago
    Haha :) We had some issues with Kimi-2.6 since it was int4 and we were investigating how to handle it :)
    • verdverm 6mo ago
      Appreciate what y'all do! We were slacking about how many HGX-B300 it would take to run Kimi and it looks like we could actually fit 2-3 Kimis on a single HGX.
      • danielhanchen 6mo ago
        Sorry on the delay - oh haha that would be cool :) We did release 2bit dynamic ones, but unsure if they'll be helpful