4 ms·
Which model can I use with 16GB ram? I tried Ollama with WizardCoder 7b, but it didn't work.
by addandsubtract 3y ago
Which model can I use with 16GB ram? I tried Ollama with WizardCoder 7b, but it didn't work.
- adastra22 3y agoNot sure.. there was a benchmark article on the front page earlier today, but now I can't seem to find it.
- wenc 3y agoWhat didn’t work? I run Ollama on my M2 Pro and all models work.
- addandsubtract 3y agoI'm getting "Error: llama runner process has terminated" when trying to run the model. According to this ticket[1], it's a memory issue. Not sure why 16GB ram are struggling with a 7b model, though. [1] https://github.com/jmorganca/ollama/issues/1231 https://github.com/jmorganca/ollama/issues/1231
- wenc 3y agoCould you try another model like Mistral 7b and see if triggers the same error? (And check your available memory) I have 16GB too and have no trouble running even 13B models.
- addandsubtract 3y agoOh, interesting. Mistral:7b works, but wizardcoder:7b-python throws the same error as before. What's another good coding model to use besides wizardcoder? Edit: wizardcoder:7b-python-q4_1 throws the same error