3 ms·
Expect the number of cases where it would give a real advantage would be pretty small. In all the cases presented, Apple gets completely destroyed even with the
by seec 3y ago
Expect the number of cases where it would give a real advantage would be pretty small.
In all the cases presented, Apple gets completely destroyed even with their best chip at around 10x worse; that is before even talking about the cost, after which you can only conclude that Apple hardware makes absolutely no sense for this type of task.
Even if you found enough tasks where the larger memory available would make a difference to average mixed performance closer to a NVidia solution, they would seriously need to lower their RAM price for this argument to hold up...
With their current commercial offering, Apple isn't competitive for anything, even though the computers and chips themselves are not bad at all.
- treprinum 3y agoM3 Max 128GB RAM inference on LLaMA2 70B is much faster than on Zephyrus G14 64GB with 4090/16GB because one can fit the whole model into the RAM and share it with GPU. For smaller models that can fit into 16GB G14 smokes M3 Max.