3 ms·
why don't you use the quantized version of kimi-k3
by heysagnik 2mo ago
why don't you use the quantized version of kimi-k3
- Schlagbohrer 2mo agoI do not see a quantized version of kimi-k3 on huggingface that can fit into 128GB. The smallest Unsloth q version is 594GB https://huggingface.co/unsloth/Kimi-K3-GGUF https://huggingface.co/unsloth/Kimi-K3-GGUF
- Godsend69 2mo ago[dead]