2 ms·
If you check out the preceeding PR[1], linked from the merged PR, the use-case is if you got a llama-server running but is restricted to console, or you just wa
by magicalhippo 4mo ago
If you check out the preceeding PR[1], linked from the merged PR, the use-case is if you got a llama-server running but is restricted to console, or you just want to debug, so you want to connect to it using llama-cli.
So it's easy to see how HTTP became the primary transport, because it facilitated the motivating use-case.
[1]: https://github.com/ggml-org/llama.cpp/pull/21674 https://github.com/ggml-org/llama.cpp/pull/21674