3 ms·
Running Gemma 4 with llama.cpp and Swival: $ llama-server --reasoning auto --fit on -hf unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_XL --temp 1.0 -
by jedisct1 6mo ago
Running Gemma 4 with llama.cpp and Swival:
$ llama-server
--reasoning auto
--fit on
-hf unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_XL
--temp 1.0 --top-p 0.95 --top-k 64
$ uvx swival --provider llamacpp
Done.