3 ms·
Not much to figure out. It's 2x M4 Max, so you need 100 of these to match the TOPS of even a single consumer card like the RTX 5090.
by NorwegianDude 2y ago
Not much to figure out. It's 2x M4 Max, so you need 100 of these to match the TOPS of even a single consumer card like the RTX 5090.
- jeffhuys 2y agoSure, but if you have models like DeepSeek - 400GB - that won't fit on a consumer card.
- NorwegianDude 2y agoTrue. But an AI shop doesn't care about that. They get more performance for the money by going for multiple Nvidia GPUs. I have 512 GB ram on my PC too with 8 memory channels, but it's not like it's usable for AI workloads. It's nice to have large amounts of RAM, but increasing the batch size during training isn't going to help when compute is the bottleneck.
- DrBenCarson 2y agoNow do VRAM
- wpm 2y agoIt's 2x M3 Max
- alberth 2y ago> It's 2x M4 Max Not exactly though. This can have 512GB unified memory, 2x M4 Max can only have 128GB total (64GB each).