2 ms·

Thanks! Do you have any guides/websites/github repos for running these models on CPUs?

• rcarmo 3y ago
  Ollama will (nearly always) work provided you have enough RAM. I was actually pretty surprised that it didn't work on my N5105 (which has 16GB) because it relies on AVX instructions...
  • user_7832 3y ago
    Thanks! Someone else mentioned llama.cpp but it appears that ollama is just a gui frontend for llama (which is good because I find guis easier). I'll hopefully set it up soon!
    • FergusArgyll 3y ago
      It's not a GUI it's a cli but very easy to use "ollama run {model}". you can also `ollama serve` which serves an api, and then you can use or build a simple gui.
      • user_7832 3y ago
        Thanks, I’ll keep that in mind!
  • jmorgan 3y ago
    Next upcoming Ollama version will support non-AVX CPUs