4 ms·If you're happy running local models, llama.cpp's built-in web-server's interface can do this.by a_e_k 1y agoIf you're happy running local models, llama.cpp's built-in web-server's interface can do this.