3 ms·
I stumbled on this yesterday, it seems to have a queue concept.. https://github.com/ParisNeo/ollama_proxy_server https://github.com/ParisNeo/ollama_proxy_serve
by ritonlajoie 2y ago
I stumbled on this yesterday, it seems to have a queue concept..
https://github.com/ParisNeo/ollama_proxy_server https://github.com/ParisNeo/ollama_proxy_server