3 ms·
Interesting, admittedly, I am slowly getting to the point, where ollama's defaults get a little restrictive. If the setup is not too onerous, I would not mind t
by A4ET8a8uTh0_v2 1y ago
Interesting, admittedly, I am slowly getting to the point, where ollama's defaults get a little restrictive. If the setup is not too onerous, I would not mind trying. Where did you start?
- tarruda 1y agoDownload llama-server from llama.cpp Github and install it some PATH directory. AFAIK they don't have an automated installer, so that can be intimidating to some people Assuming you have llama-server installed, you can download + run a hugging face model with something like llama-server -hf ggml-org/gpt-oss-20b-GGUF -c 0 -fa --jinja And access http://localhost:8080 http://localhost:8080