3 ms·
The CLI for llama.cpp is very clunky IMO. I put some kind of UI on it when I want to get something done.
by sp332 3y ago
The CLI for llama.cpp is very clunky IMO. I put some kind of UI on it when I want to get something done.
- spmurrayzzz 3y agoIt also ships with an openai-compatible server implementation as well now that you could point your UI at (if you wanted to run leaner w/out ollama). https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md https://github.com/ggerganov/llama.cpp/blob/master/examples/...