4 ms·

Thanks to unsloth, we immediately get 4-bit quantization: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF https://huggingface.co/unsloth/Qwen3.6-27B-GGUF

• perarneng 6mo ago
  Im waiting for nvfp4 quant :-)
  • EnPissant 6mo ago
    Are nvfp4 / mxfp4 even useful without QAT?