3 ms·

Isn't Kimi K2.6 natively INT4?

• simjnd 5mo ago
  I don't think any models are natively INT4? I wouldn't see the point to nerf the model out-of-the-box.
  • zozbot234 5mo ago
    It's not nerfed, it's natively trained at that quantization a.k.a. Quantization Aware Training.
    • pbgcp2026 5mo ago
      QAT typically uses BF16/FP32 during the training process to simulate lower precision.
  • EntityDeletr 5mo ago
    The only model I have seen like that is GPT OSS, natively quantized to MXFP4.