3 ms·
Note that Kimi K2x is natively 4 bit int, which reduces the memory requirements somewhat.
by kristianp 9mo ago
Note that Kimi K2x is natively 4 bit int, which reduces the memory requirements somewhat.
- kristianp 9mo agoHere's the citation for that, I think its not in the Technical Report. https://huggingface.co/moonshotai/Kimi-K2.5#4-native-int4-quantization https://huggingface.co/moonshotai/Kimi-K2.5#4-native-int4-qu...