2 ms·

2.71bit DeepSeek-V3-0324

• danielhanchen 2y ago
  I shrank DeepSeek V3 to 230GB or so from 720GB and it works still! Model uploads are at https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF