3 ms·
Maybe a silly question, but is there a reason/advantage to using mac minis over any other kind of small computer/laptop, ie running linux? My understanding of
by t1E9mE7JTRjf 24d ago
Maybe a silly question, but is there a reason/advantage to using mac minis over any other kind of small computer/laptop, ie running linux?
My understanding of using a mac mini for ai (ie running a claw bot or whatever) is to have it 'always on' and a better price/performance profile than a cheap vps.
Is there performance (silicon processor?) so unique? As I guess it's not their graphics units. I see tonnes of people using mac minis for AI, to the point it almost became a meme.
Edit: yes I know this article is about local models, my question is a bit more general.
- bbatha 24d agoUnified memory is the answer, it’s one of the cheapest ways to get >64GB of gpu addressable memory.
- wuschel 24d agoThe main difference total other laptops of non-Apple make is/was unified memory (graphic VRAM + RAM) architecture. No need for an extra dedicated graphics card to get 64+ GB VRAM.
- em500 24d agoThere are probably three main reasons: 1) unified memory (but you can also that with DGS Spark / Strix Halo), 2) access to your Apple account, so you can have a bot handle your iMessages, email, calendars 3) energy efficiency. Apart from that, if it doesn't work out you still have a Mac Mini, which in itself is more desirable for many than a DGX Spark or Strix Halo if you have no AI use case.
- numpad0 24d agoNo, it's just hype and people cargo culting local LLM guys buying maxed out Mac Studio for its massive and relatively fast GPU-assignable RAM.