I just use ollama. It works on my mac and windows machine and it's super simple to install + run most open models. And you can have another tool just shell out

I just use ollama. It works on my mac and windows machine and it's super simple to install + run most open models. And you can have another tool just shell out to it if you want more than than the CLI.