21 ms·
Good point, I didn’t mention the hardware requirements in the article. Ollama runs best with a dedicated GPU, but it can work on CPUs (just much slower). If you
by sajiron 2y ago
Good point, I didn’t mention the hardware requirements in the article. Ollama runs best with a dedicated GPU, but it can work on CPUs (just much slower). If you're on a MacBook with an M1 or higher chip, it should work, but performance won’t be great.
I haven’t set up Ollama on DigitalOcean yet, but since they offer GPU instances, it should be a solid option. I’ll test it and write a guide soon.
Compared to running locally or using something like Hugging Face, DigitalOcean gives more power and flexibility but requires setup, while Hugging Face is easier but less customizable. I’ll share an update once I’ve tested the DigitalOcean setup