5 ms·

High end Intel and AMD chips hold the performance crown but the M chips utterly destroy them on performance per watt. It’s not even close. It’s a mix of a simp

by api 4y ago

High end Intel and AMD chips hold the performance crown but the M chips utterly destroy them on performance per watt. It’s not even close. It’s a mix of a simpler ISA, good core design, and small process nodes.

erik 4y ago
> It’s a mix of a simpler ISA, good core design, and small process nodes. It's also a design that prioritizes perf/watt, whereas CPU vendors tend to prioritize perf/area. (aka perf/$)
- kllrnohj 4y ago
  Other ARM SoC vendors do, absolutely, which is a big factor in why most other ARM SoCs are so far behind Apple's. But Intel & AMD less so, they tend to prioritize just outright performance since that's how they're nearly always compared & judged. Die size hasn't really been a constraint for them.
toolz 4y ago
> the M chips utterly destroy them on performance per watt. It’s not even close. AMD laptop CPUs easily compete with or even beat the M chips according to this comparison. https://www.cpubenchmark.net/compare/5215vs4104/AMD-Ryzen-7-7730U-vs-Apple-M1-8-Core-3200-MHz https://www.cpubenchmark.net/compare/5215vs4104/AMD-Ryzen-7-...
- josephg 4y ago
  Hm; that shows TDP - but TDP is a pretty meaningless number these days. How is the battery life in practice? Are there laptops with AMD chips which can run all day like Apple's M1/M2 laptops?
  - bigbluedots 4y ago
    Oops, look over there for the new goalposts!
    - josephg 4y ago
      The context was this: > High end Intel and AMD chips hold the performance crown but the M chips utterly destroy them on performance per watt. It’s not even close. I think asking about battery life is pretty relevant.
      - polishTar 4y ago
        Strongly agree. It's not moving the goalposts when the metric is useless. TDP means nothing nowadays because CPUs can significantly exceed them when turboing if they've got thermal headroom. IMO, real power consumption in joules over the course of a benchmark needs to be the standard when it comes to comparing efficiency.
      - skykooler 4y ago
        I wish this was a more common benchmark for graphics cards - with newer graphics cards pushing higher and higher TDPs, it would be nice to have a way to look for "best performance while keeping power draw the same as the previous GPU".
    - blackflame7000 4y ago
      [dead]
    - mort96 4y ago
      TDP is not a number you can use in performance per watt comparisons. No goalposts were moved.
  - brucethemoose2 4y ago
    Rembrandt is excellent... on linux, if you throttle it. The main issue is that AMD/Intel turbo so hard, while Apple clocks their M chips much more conservatively. They are also much bigger, wider designs than AMD (which means they are more expensive but can afford to run slower). Another is that Windows + OEM garbage + random background apps do so much useless processing in the background. And I'm not even a pro-linux "bloat" zealot... it really is just senseless and unacceptable out-of-the-box.
    - josephg 4y ago
      > Another is that Windows + OEM garbage + random background apps do so much useless processing in the background. And I'm not even a pro-linux "bloat" zealot... it really is just senseless and unacceptable out-of-the-box. Modern MacOS is nearly as bad. I upgraded a couple of years ago from a dual core 2016 macbook pro. The machine - even freshly formatted - spent an obscene amount of CPU time doing useless things - like in photoanalysisd (presumably looking for my face in my iphoto library for the 100th time). Or indexing my hard drive again, for no reason. The efficiency cores in my new M1 machine seem to hover at about 50% most of the time I'm using the computer. I've started to think of them as the silly corner for Apple's bored software engineers to play around in, so the random background processes they start don't get in the way of getting actual work done. I wish I could figure out how to turn all this crap off. Its no wonder linux on M1 chips is already benchmarking better than the same machines running MacOS, at least on CPU bound tasks. (That said, OEM bloatware on windows is a whole other level of hurt.)
      - brucethemoose2 4y ago
        Oof, I didn't know it was that bad. On the other hand, a low frequency efficiency core is a good place for "bloat" to live. I think thats how Android/iOS remain usable too. Windows bloat on AMD runs on the big 4Ghz+ cores. And I suspect it does on Intel laptops with E cores too, as Windows isn't integrated enough to know that the Adobe updater and Norton Antivirus and the HP App Store are E core tasks. And even if it does, Intel runs their E cores faster than Apple anyway.
      - heavyset_go 4y ago
- KerrAvon 4y ago
  That doesn’t look apples-to-apples to me. That’s thousands of samples of a two year old low-end M1 vs 2 samples of a brand new Ryzen mid-range (AFAICT). (And the Ryzen still loses at single core performance.)
  - jeswin 4y ago
    1. AMD just got to 5nm, and hence this is more apples-to-apples if we're talking about design efficiency (rather than TSMC's capabilities) 2. The brand new M2s are only about 20% faster, so the results are still valid.
  - userbinator 4y ago
    Missed opportunity to call it apples-to-Apples ;-) But I do wonder, given the other comments here about TDP and these days of thermally-limited performance, what the results are if both are locked to the same constant frequency.
    - ElectricalUnion 4y ago
      Nah, besides crazy speculative behaviour, automatic overcloking is how modern chips are so fast compared to a few years ago. And usually for battery power, it's often better to run really hot for a small ammount of time, that to run for a extended ammount of time at lower clocks.
  - heavyset_go 4y ago
    It's an apples-to-apples comparison when it comes to the node process. AMD's latest CPUs are made on 5nm and 4nm nodes, something that Apple was only able to do with the M1/M2 because they booked all of TSMC's 5nm node capacity. It's only recently that other companies like AMD are able to use TSMC's 5nm node process.
josephg 4y ago
Yep. And its a close race between Apple's ARM chips and the latest x86 chips from Intel and AMD. If GeekBench is to be believed, Apple's best chips are only about 10-15% behind the performance of the top x86 desktop class CPUs, despite only using a fraction of the power. Apple's M_ Max CPU variants come with a very hefty price tag though.
- kllrnohj 4y ago
  > Apple's best chips are only about 10-15% behind the performance of the top x86 desktop class CPUs, despite only using a fraction of the power. Power consumption scales non-linearly with clock speed. So you're comparing two variables that are dependent on each other. If you want a meaningful comparison, you have to align one of those variables. As in, either reduce x86 to M2 Pro/Ultra/Whatever's power budget and then compare performance, or align performance and then compare power. This is especially true for the desktop class CPUs where outright performance is the name of the game at all costs. AMD & Intel are constantly throwing upwards of 50w at an extra 5% performance, because that's what drives sales - outright performance.
derefr 4y ago
Makes me wonder what the highest perf would look like out of an arbitrary hypothetical multi-socket Apple Silicon system, vs an arbitrary multi-socket x86 system; where the only constraints for both systems are that the boards have a fixed power budget. (I.e. "who wins in a map/reduce task: a board that spends 1000W to power 4 Xeons, or a board that spends 1000W to power 20 M2 Ultras?") Too bad there are no bare/unsoldered Apple Silicon chips to try building such boards around. I'm sure, if there were, you'd find them all over AliExpress. I'd also be curious which of those two boards would have a higher BOM!
- bee_rider 4y ago
  What’s the fastest network for a M2 Ultra? Can we run some MPI codes?
  - piperswe 4y ago
    You could probably run a QDR+QSFP Infiniband card at around 32Gbps (minus overhead) through an external "GPU" enclosure. I don't see why MPI wouldn't work on Asahi Linux with such a setup once there's Thunderbolt support.
    - jabl 4y ago
      QDR Infiniband is, like, 2007 level tech. Today we have NDR Infiniband where a typical 4xHCA gets you 400 GB/s. Seems like a hypothetical Mac cluster would be severely limited by this compared to the typical x86 based server clusters.
      - bee_rider 4y ago
        I’m sure such a switch would be serving some pretty beefy nodes, though, right? Maybe the compute:communication can be held constant with less-powerful Mac mini nodes?
      - piperswe 4y ago
        The problem is that the Thunderbolt ports don't support that bandwidth, and there isn't any other way to connect PCIe peripherals.
heavyset_go 4y ago
Newer mobile AMD APUs get close to the M1 Pro's power usage while exceeding the M1's performance[1]. Those same APUs get even closer when compared to the M2 Pro[2]. [1] https://nanoreview.net/en/cpu-compare/apple-m1-pro-vs-amd-ryzen-9-7940hs https://nanoreview.net/en/cpu-compare/apple-m1-pro-vs-amd-ry... [2] https://nanoreview.net/en/cpu-compare/apple-m2-pro-vs-amd-ryzen-9-7940hs https://nanoreview.net/en/cpu-compare/apple-m2-pro-vs-amd-ry...
- nvrspyx 4y ago
  Isn't the M2 Pro more power efficient than the M1 Pro? At least it is according to [1]. So isn't it further away compared to the M2 Pro, not closer? Or are you saying that the M2 Pro is closer in performance to the Ryzen 9 than the M1 Pro, rather than in power usage? I'm not really knowledgeable when it comes to this, so perhaps I'm missing something. 1: https://nanoreview.net/en/cpu-compare/apple-m2-pro-vs-apple-m1-pro https://nanoreview.net/en/cpu-compare/apple-m2-pro-vs-apple-...
pjmlp 4y ago
Except that Apple is long out of the server business. A mini rack isn't competition to a couple of Xeons.

by api 4y ago

erik 4y ago

> It’s a mix of a simpler ISA, good core design, and small process nodes. It's also a design that prioritizes perf/watt, whereas CPU vendors tend to prioritize perf/area. (aka perf/$)

kllrnohj 4y ago
Other ARM SoC vendors do, absolutely, which is a big factor in why most other ARM SoCs are so far behind Apple's. But Intel & AMD less so, they tend to prioritize just outright performance since that's how they're nearly always compared & judged. Die size hasn't really been a constraint for them.

toolz 4y ago

> the M chips utterly destroy them on performance per watt. It’s not even close. AMD laptop CPUs easily compete with or even beat the M chips according to this comparison. https://www.cpubenchmark.net/compare/5215vs4104/AMD-Ryzen-7-7730U-vs-Apple-M1-8-Core-3200-MHz https://www.cpubenchmark.net/compare/5215vs4104/AMD-Ryzen-7-...

josephg 4y ago
Hm; that shows TDP - but TDP is a pretty meaningless number these days. How is the battery life in practice? Are there laptops with AMD chips which can run all day like Apple's M1/M2 laptops?
- bigbluedots 4y ago
  Oops, look over there for the new goalposts!
  - josephg 4y ago
    The context was this: > High end Intel and AMD chips hold the performance crown but the M chips utterly destroy them on performance per watt. It’s not even close. I think asking about battery life is pretty relevant.
    - polishTar 4y ago
      Strongly agree. It's not moving the goalposts when the metric is useless. TDP means nothing nowadays because CPUs can significantly exceed them when turboing if they've got thermal headroom. IMO, real power consumption in joules over the course of a benchmark needs to be the standard when it comes to comparing efficiency.
    - skykooler 4y ago
      I wish this was a more common benchmark for graphics cards - with newer graphics cards pushing higher and higher TDPs, it would be nice to have a way to look for "best performance while keeping power draw the same as the previous GPU".
  - blackflame7000 4y ago
    [dead]
  - mort96 4y ago
    TDP is not a number you can use in performance per watt comparisons. No goalposts were moved.
- brucethemoose2 4y ago
  Rembrandt is excellent... on linux, if you throttle it. The main issue is that AMD/Intel turbo so hard, while Apple clocks their M chips much more conservatively. They are also much bigger, wider designs than AMD (which means they are more expensive but can afford to run slower). Another is that Windows + OEM garbage + random background apps do so much useless processing in the background. And I'm not even a pro-linux "bloat" zealot... it really is just senseless and unacceptable out-of-the-box.
  - josephg 4y ago
    > Another is that Windows + OEM garbage + random background apps do so much useless processing in the background. And I'm not even a pro-linux "bloat" zealot... it really is just senseless and unacceptable out-of-the-box. Modern MacOS is nearly as bad. I upgraded a couple of years ago from a dual core 2016 macbook pro. The machine - even freshly formatted - spent an obscene amount of CPU time doing useless things - like in photoanalysisd (presumably looking for my face in my iphoto library for the 100th time). Or indexing my hard drive again, for no reason. The efficiency cores in my new M1 machine seem to hover at about 50% most of the time I'm using the computer. I've started to think of them as the silly corner for Apple's bored software engineers to play around in, so the random background processes they start don't get in the way of getting actual work done. I wish I could figure out how to turn all this crap off. Its no wonder linux on M1 chips is already benchmarking better than the same machines running MacOS, at least on CPU bound tasks. (That said, OEM bloatware on windows is a whole other level of hurt.)
    - brucethemoose2 4y ago
      Oof, I didn't know it was that bad. On the other hand, a low frequency efficiency core is a good place for "bloat" to live. I think thats how Android/iOS remain usable too. Windows bloat on AMD runs on the big 4Ghz+ cores. And I suspect it does on Intel laptops with E cores too, as Windows isn't integrated enough to know that the Adobe updater and Norton Antivirus and the HP App Store are E core tasks. And even if it does, Intel runs their E cores faster than Apple anyway.
    - heavyset_go 4y ago
KerrAvon 4y ago
That doesn’t look apples-to-apples to me. That’s thousands of samples of a two year old low-end M1 vs 2 samples of a brand new Ryzen mid-range (AFAICT). (And the Ryzen still loses at single core performance.)
- jeswin 4y ago
  1. AMD just got to 5nm, and hence this is more apples-to-apples if we're talking about design efficiency (rather than TSMC's capabilities) 2. The brand new M2s are only about 20% faster, so the results are still valid.
- userbinator 4y ago
  Missed opportunity to call it apples-to-Apples ;-) But I do wonder, given the other comments here about TDP and these days of thermally-limited performance, what the results are if both are locked to the same constant frequency.
  - ElectricalUnion 4y ago
    Nah, besides crazy speculative behaviour, automatic overcloking is how modern chips are so fast compared to a few years ago. And usually for battery power, it's often better to run really hot for a small ammount of time, that to run for a extended ammount of time at lower clocks.
- heavyset_go 4y ago
  It's an apples-to-apples comparison when it comes to the node process. AMD's latest CPUs are made on 5nm and 4nm nodes, something that Apple was only able to do with the M1/M2 because they booked all of TSMC's 5nm node capacity. It's only recently that other companies like AMD are able to use TSMC's 5nm node process.

josephg 4y ago

Yep. And its a close race between Apple's ARM chips and the latest x86 chips from Intel and AMD. If GeekBench is to be believed, Apple's best chips are only about 10-15% behind the performance of the top x86 desktop class CPUs, despite only using a fraction of the power. Apple's M_ Max CPU variants come with a very hefty price tag though.

kllrnohj 4y ago
> Apple's best chips are only about 10-15% behind the performance of the top x86 desktop class CPUs, despite only using a fraction of the power. Power consumption scales non-linearly with clock speed. So you're comparing two variables that are dependent on each other. If you want a meaningful comparison, you have to align one of those variables. As in, either reduce x86 to M2 Pro/Ultra/Whatever's power budget and then compare performance, or align performance and then compare power. This is especially true for the desktop class CPUs where outright performance is the name of the game at all costs. AMD & Intel are constantly throwing upwards of 50w at an extra 5% performance, because that's what drives sales - outright performance.

derefr 4y ago

Makes me wonder what the highest perf would look like out of an arbitrary hypothetical multi-socket Apple Silicon system, vs an arbitrary multi-socket x86 system; where the only constraints for both systems are that the boards have a fixed power budget. (I.e. "who wins in a map/reduce task: a board that spends 1000W to power 4 Xeons, or a board that spends 1000W to power 20 M2 Ultras?") Too bad there are no bare/unsoldered Apple Silicon chips to try building such boards around. I'm sure, if there were, you'd find them all over AliExpress. I'd also be curious which of those two boards would have a higher BOM!

bee_rider 4y ago
What’s the fastest network for a M2 Ultra? Can we run some MPI codes?
- piperswe 4y ago
  You could probably run a QDR+QSFP Infiniband card at around 32Gbps (minus overhead) through an external "GPU" enclosure. I don't see why MPI wouldn't work on Asahi Linux with such a setup once there's Thunderbolt support.
  - jabl 4y ago
    QDR Infiniband is, like, 2007 level tech. Today we have NDR Infiniband where a typical 4xHCA gets you 400 GB/s. Seems like a hypothetical Mac cluster would be severely limited by this compared to the typical x86 based server clusters.
    - bee_rider 4y ago
      I’m sure such a switch would be serving some pretty beefy nodes, though, right? Maybe the compute:communication can be held constant with less-powerful Mac mini nodes?
    - piperswe 4y ago
      The problem is that the Thunderbolt ports don't support that bandwidth, and there isn't any other way to connect PCIe peripherals.

heavyset_go 4y ago

Newer mobile AMD APUs get close to the M1 Pro's power usage while exceeding the M1's performance[1]. Those same APUs get even closer when compared to the M2 Pro[2]. [1] https://nanoreview.net/en/cpu-compare/apple-m1-pro-vs-amd-ryzen-9-7940hs https://nanoreview.net/en/cpu-compare/apple-m1-pro-vs-amd-ry... [2] https://nanoreview.net/en/cpu-compare/apple-m2-pro-vs-amd-ryzen-9-7940hs https://nanoreview.net/en/cpu-compare/apple-m2-pro-vs-amd-ry...

nvrspyx 4y ago
Isn't the M2 Pro more power efficient than the M1 Pro? At least it is according to [1]. So isn't it further away compared to the M2 Pro, not closer? Or are you saying that the M2 Pro is closer in performance to the Ryzen 9 than the M1 Pro, rather than in power usage? I'm not really knowledgeable when it comes to this, so perhaps I'm missing something. 1: https://nanoreview.net/en/cpu-compare/apple-m2-pro-vs-apple-m1-pro https://nanoreview.net/en/cpu-compare/apple-m2-pro-vs-apple-...

pjmlp 4y ago

Except that Apple is long out of the server business. A mini rack isn't competition to a couple of Xeons.