The latter mostly. It's also free, uncensored, and can never disappear from under me. FWIW, from my understanding llama.cpp is pretty easy to integrate and is

The latter mostly. It's also free, uncensored, and can never disappear from under me. FWIW, from my understanding llama.cpp is pretty easy to integrate and is reasonably fast for being API agnostic. Ollama embeds it, for example. No pressure, just pointing it out :)