3 ms·
I find it fascinating that this was released after the June 2022 launch of the M2 chipset and line of products, and yet Apple had no desire to show relative per
by btown 4y ago
I find it fascinating that this was released after the June 2022 launch of the M2 chipset and line of products, and yet Apple had no desire to show relative performance of M2 vs. M1 here - even in the simultaneous announcement here: https://machinelearning.apple.com/research/neural-engine-transformers https://machinelearning.apple.com/research/neural-engine-tra...
It's fascinating to me that at least one of two things is true: either (a) Apple has lost its ability to coordinate "hype" between its teams, or (b) the difference between comparable levels e.g. the M1 Max vs. the M2 Max are so negligible that they don't look good in an announcement like this.
Has anyone run inference for LLMs or other transformer models on comparable M1 and M2 Macs? Are there good benchmarks for this specific workload?
- coldtea 4y ago>I find it fascinating that this was released after the June 2022 launch of the M2 chipset and line of products And this was put out in Aug 2022. It's very propable that the team worked on it and tested it just on M1, and M2 was kept under wraps in different teams working on it until the announcement. So they just wrote the annoucement on the CPUs they worked on - and since it's not for a commercial product, Apple didn't care to optimize marketing anyway.
- windowsrookie 4y agoIt's my understanding the the performance difference is very small between the M1 and M2. So small that Apple is still selling new M1 Macs today. The M2 added more GPU cores and an advanced media decoder.
- pbronez 4y agoInteresting. Maybe they just wanted to publish quickly and didn’t take the time to benchmark across? Seems like a miss. M2 NPU is supposed to be 44% better than M1 https://www.cpu-monkey.com/en/article/apple_m2_vs_apple_m1__what_are_the_differences https://www.cpu-monkey.com/en/article/apple_m2_vs_apple_m1__...