4 ms·
Macs have a larger iGPU and faster RAM than pretty much any comparable PC, which are precisely the two things you want for LLMs. Also, lots of people only own
by brucethemoose2 3y ago
Macs have a larger iGPU and faster RAM than pretty much any comparable PC, which are precisely the two things you want for LLMs.
Also, lots of people only own a Mac.
You'd have to be kinda crazy to buy a Mac explicitly for running/training genai though.
- lostmsu 3y agoI don't think you want iGPU for LLMs. 4090 + RAM offload would be many times faster.
- brucethemoose2 3y ago3090 + RAM offload is not very fast on my desktop. Its fine, but the speed hit is large. And I was thinking regular laptops as a baseline vs the base M1/M2.
- lostmsu 3y agoMacBooks don't have enough RAM to train without offloading to SSD which would be even slower.