4 ms·
Yeah, the mac minis can have up to 64GB of ram which would support some usable models. However, I accidentally got one with 24gb of ram, and my apps already use
by philip1209 2y ago
Yeah, the mac minis can have up to 64GB of ram which would support some usable models. However, I accidentally got one with 24gb of ram, and my apps already use 12gbs. So, perhaps I'll get a second box just for LLMs!
- aurareturn 2y agoA small model like 1B or 3B should be ok with 16GB. I was thinking in the name of savings, you can just use the same machine. It's a cool project. I might do it too. I have an M4 Mini sitting on my desk that I got for $550.
- deleted 2y ago[deleted]