I started by using lama.cpp directly, and a few other options. I now just use Ollama because it is simple to download models, keep software and models up to dat

I started by using lama.cpp directly, and a few other options. I now just use Ollama because it is simple to download models, keep software and models up to date, and really easy to run a local REST query service. I like spending more time playing with application ideas and less time running infrastructure. Of course, lama.cpp under the hood provides the magic.