2 ms·
Show HN: A single CLI to manage llama.cpp/vLLM/Ollama models
Harbor crossed its 127th (next one is special) release.
One notable added feature is ability to manage all my LLMs with a single CLI.
# list all models
harbor ls
# pairs well with jq
harbor ls --json
# Ollama
harbor pull qwen3.5:35b
# llama.cpp
harbor pull unsloth/Qwen3.5-35B-A3B-GGUF:Q8_0
# vllm (HuggingFace Hub cache)
harbor pull Qwen/Qwen3.5-35B-A3B
# Remove any of the models by the same id
# used to pull it
harbor rm <id>
Hopefully it'll be useful for someone too.
- ranausmanai 7mo agoSuper interesting. I am also working a lot on CLI's these days
- spranab 7mo ago[dead]