3 ms·
Kiki K2 was made to be optimized at 4-bit, though.
by geerlingguy 10mo ago
Kiki K2 was made to be optimized at 4-bit, though.
- natrys 10mo agoThat's the Kimi K2 Thinking, this post seems to be talking about original Kimi K2 Instruct though, I don't think INT4 QAT (quantization aware training) version was released for this.