Ollama is fantastic. Truly makes running an LLM locally as easy as installing an app. Their node/python connectors are great, too. I've been able to reduce cos

Ollama is fantastic. Truly makes running an LLM locally as easy as installing an app. Their node/python connectors are great, too. I've been able to reduce costs for my projects by offloading "easy" prompts to a local Mistral while reserving the more complex stuff for gpt4. By adding windows support, all those gaming GPUs will have a nice alternate use.