4 ms·
We uploaded GGUFs for anyone who wants to run them locally. [EDIT] - I fixed all chat templates so no need for --jinja as at 10:00PM SF time. Phi-4-mini-reaso
by danielhanchen 1y ago
We uploaded GGUFs for anyone who wants to run them locally.
[EDIT] - I fixed all chat templates so no need for --jinja as at 10:00PM SF time.
Phi-4-mini-reasoning GGUF: https://huggingface.co/unsloth/Phi-4-mini-reasoning-GGUF https://huggingface.co/unsloth/Phi-4-mini-reasoning-GGUF
Phi-4-reasoning-plus-GGUF: https://huggingface.co/unsloth/Phi-4-reasoning-plus-GGUF https://huggingface.co/unsloth/Phi-4-reasoning-plus-GGUF
- danielhanchen 1y agoFinal edit 11:40PM PT/SF time: I noticed not using --jinja doesn't work - so unfortunately you'll have to use it. Also it looks very very very verbose. The recommended settings are --temp 0.8 --top-p 0.95