4 ms·llama-cpp provides an API server as well via llama-server (and a competent webgui too).by sieve 7mo agollama-cpp provides an API server as well via llama-server (and a competent webgui too).