3 ms·
Really nice. Install it, it runs as service and "ollama run model-name" that you get on the page. It will download, some are really big, but any 32GB ram pc wil
by roscas 1y ago
Really nice. Install it, it runs as service and "ollama run model-name" that you get on the page. It will download, some are really big, but any 32GB ram pc will run any up to 32B parameters.
It helps a lot to have a good graphics card with the most amount of ram you can buy.
If you don't have a good graphics, the CPU will have to do it al and will take a few seconds/minutes to compute the output. So pick a model up to 14B and those are a bit much for only cpu power.
There are also some "studio" interfaces that are nice and work with Ollama. They usually facilate the download and the ouput, I don't use it.
I only use Ollama on the terminal.