4 ms·Llama-server which is part of llamacpp does this for a few months nowby ekianjo 6mo agoLlama-server which is part of llamacpp does this for a few months now