3 ms·
I made some dynamic GGUFs for the 32B MoE model! Try: ./llama.cpp/llama-cli -hf unsloth/granite-4.0-h-small-GGUF:UD-Q4_K_XL Also a support agent finetuning no
by danielhanchen 1y ago
I made some dynamic GGUFs for the 32B MoE model! Try:
./llama.cpp/llama-cli -hf unsloth/granite-4.0-h-small-GGUF:UD-Q4_K_XL
Also a support agent finetuning notebook with granite 4: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Granite4.0.ipynb https://colab.research.google.com/github/unslothai/notebooks...
- anshumankmr 1y agoYou guys are lightning fast. Did you folks have access to the model weights before hand or something, if you don't mind me asking?
- danielhanchen 1y agoOh thanks! Yes sometimes we get early access to some models!
- incomingpain 1y agoAs always, you're awesome. keep up the great work!
- danielhanchen 1y agoThanks!