5 ms·
Why is the 4bit version 1.2TB and the non-4bit version 650GB? https://huggingface.co/mlx-community/Kimi-K2-Thinking-4bit https://huggingface.co/mlx-community/K
by ElijahLynn 11mo ago
Why is the 4bit version 1.2TB and the non-4bit version 650GB?
https://huggingface.co/mlx-community/Kimi-K2-Thinking-4bit https://huggingface.co/mlx-community/Kimi-K2-Thinking-4bit
https://huggingface.co/mlx-community/Kimi-K2-Thinking https://huggingface.co/mlx-community/Kimi-K2-Thinking
- kachapopopow 11mo agoI think it the default version here might be 2.5bit or something