2 ms·
I guess the parallel is "Ollama serve" which provides you with a direct REST API to interact with a LLM.
by ekianjo 8mo ago
I guess the parallel is "Ollama serve" which provides you with a direct REST API to interact with a LLM.
- sieve 8mo agollama-cpp provides an API server as well via llama-server (and a competent webgui too).