3 ms·
I shrank DeepSeek V3 to 230GB or so from 720GB and it works still! Model uploads are at https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF https://huggingface
by danielhanchen 2y ago
I shrank DeepSeek V3 to 230GB or so from 720GB and it works still! Model uploads are at https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF