3 ms·
Somewhat related. I’ve got an M2 Max Mac Studio with 32GB of ram. Is there anything interesting I can do with it in terms of ML? What’s the scene like on modera
by steve_adams_86 3y ago
Somewhat related. I’ve got an M2 Max Mac Studio with 32GB of ram. Is there anything interesting I can do with it in terms of ML? What’s the scene like on moderately powered equipment like this?
- sparker72678 3y agoTry https://ollama.ai https://ollama.ai Super easy to get setup and play around. Probably start with Llama2 13b or 7b, and then Mistral 7b. If you want a dead-simple chat GUI for interfacing, check out Ollamac.
- steve_adams_86 3y agoWow, just like that. Straight to the races. Thank you! Kind of regretting not getting 64GB of ram now. I didn't think I'd need it, but... Here I am, wishing I could run some of these models.