2 ms·
Yes. -hfd for the draft model.
by dofm 5mo ago
Yes.
-hfd for the draft model.
- c-hendricks 5mo agoNice, was wondering if there was a flag for the draft as well. Not knocking huggingface-cli, just find it's much easier for people to try out this stuff when they can just mise use --global github:ggml-org/llama.cpp LLAMA_CACHE="models" llama-server \ -hf unsloth/gemma-4-26B-A4B-it-qat-GGUF:UD-Q4_K_XL \ --host 0.0.0.0 \ --port 11434 \ ...
- dofm 5mo ago—no-mmproj is also pretty useful if you're doing this just to try agentic coding and you're not processing images/voice. Stops it downloading the multimodal projector.