3 ms·
That's amazing. Mac Mini is very efficient and is a great little home server. Idles at 3-4w total for the entire machine. Plus, the M4 is a beast of a CPU. It m
by aurareturn 2y ago
That's amazing. Mac Mini is very efficient and is a great little home server. Idles at 3-4w total for the entire machine. Plus, the M4 is a beast of a CPU. It might even be possible to serve a small LLM model like a 3b model on it over the internet.
- philip1209 2y agoYeah, the mac minis can have up to 64GB of ram which would support some usable models. However, I accidentally got one with 24gb of ram, and my apps already use 12gbs. So, perhaps I'll get a second box just for LLMs!
- aurareturn 2y agoA small model like 1B or 3B should be ok with 16GB. I was thinking in the name of savings, you can just use the same machine. It's a cool project. I might do it too. I have an M4 Mini sitting on my desk that I got for $550.
- deleted 2y ago[deleted]