4 ms·
I don't know because I have 36GB memory on Apple Silicon and mostly use models that require around 32GB, but I will say that people underestimate the abilities
by runjake 1y ago
I don't know because I have 36GB memory on Apple Silicon and mostly use models that require around 32GB, but I will say that people underestimate the abilities of ~7b models for many tasks.
- OccamsMirror 1y agoWhat ~7b models would you recommend investigating?
- runjake 1y agoStart with the 7b and 8b models popular on Ollama's listings: https://ollama.com/search?q=7b https://ollama.com/search?q=7b https://ollama.com/search?q=8b https://ollama.com/search?q=8b It's not showing up high on the list of the above URLs for some reason, but I quite enjoy the deepseek-r1 8b variant: https://ollama.com/library/deepseek-r1 https://ollama.com/library/deepseek-r1 YMMV