4 ms·
Does it do queuing ? Didn’t see it in the readme. I haven’t seen (but that says nothing at all) an open source solution that queues when all are busy and allow
by anonzzzies 2y ago
Does it do queuing ? Didn’t see it in the readme. I haven’t seen (but that says nothing at all) an open source solution that queues when all are busy and allow me to show a countdown of people in the queue. Like the closed ones do.
- ritonlajoie 2y agoI stumbled on this yesterday, it seems to have a queue concept.. https://github.com/ParisNeo/ollama_proxy_server https://github.com/ParisNeo/ollama_proxy_server
- mcharytoniuk 2y agoIn progress. I added that to the readme; I need the feature myself. :)
- friendly_chap 2y agoI have actually open sourced one recently which supports queues - its both a desktop app and a daemon: https://github.com/singulatron/singulatron https://github.com/singulatron/singulatron
- 3abiton 2y agoSo many interesting projects, I just wish AI hardware was readily available.