3 ms·
What's funny is that ollama just runs the llama.cpp example http server on a random port under the hood and proxies requests to it, it doesn't even link against
by tyho 2y ago
What's funny is that ollama just runs the llama.cpp example http server on a random port under the hood and proxies requests to it, it doesn't even link against llama.cpp
- v3ss0n 2y agoYeah they intrusively listen on a port. It is security redflag.