4 ms·
Yup, the only reason Macs have higher memory bandwidth is because they use more memory channels, which gives them a wider bus. Both Intel and AMD only allow mor
by Rohansi 2mo ago
Yup, the only reason Macs have higher memory bandwidth is because they use more memory channels, which gives them a wider bus. Both Intel and AMD only allow more than dual channel memory on server class processors these days.
- kstrauser 2mo agoThe “Apple only does X better because they do Y” thing has been a meme for ages. I remember dismissals like “PowerPC is only faster at math because it has more integer units” or something along those lines, and thinking, uh, isn’t that a good thing?
- JohnBooty 2mo ago"You're only better than me at sports because you practice more and try harder!"
- pixl97 2mo agoDepends on the expense trade off. If I get 10% more performance for 50% more cost it really depends on one's needs, for example.
- Rohansi 2mo agoI am just saying it's not magic and x86 is capable of doing the same. Quad channel memory used to be more common in consumer hardware but now it looks like you don't even have the option anymore for desktops. AMD's Strix Halo was the first sign to reversing that (it has quad channel memory!) and hopefully we see more of that in the future.
- colejohnson66 2mo agoAMD does market segmentation and limits consumer chips to dual-channel. You need to cough up the dough and get Threadripper for quad-channel. Or even more for Threadripper Pro to get octa-channel.
- Rohansi 2mo agoAs I mentioned above AMD's Strix Halo has quad channel memory and is consumer level. But yes, other than that everything is segmented away.
- torginus 2mo agoAfaik steam deck is quad channel, despite it being a pretty low end chip (with a decent GPU though)
- Rohansi 2mo agoKind of but not really. DDR5 splits your typical 64-bit channel into two 32-bit subchannels meaning the bus width is not increased. These subchannels are not always advertised because it's a just a feature of DDR5. Actually adding more channels increases bus width, which is what meaningfully improves memory bandwidth.
- pdpi 2mo agoThere's a qualitative difference between "they're doing a different thing" and "they're doing the same thing, tuned differently". GP is saying that this is a case of "they just tuned it differently". This distinction doesn't change what the performance numbers look like today, but it does inform what changes would be necessary for those numbers to look different tomorrow. E.g. Apple Silicon isn't fundamentally orders of magnitude more efficient than x86, they just used smaller features. Newer Intel and AMD chips made on equivalent processes _also_ get similar efficiency gains.
- sroussey 2mo agoThere are AMD and Intel devices on similar process (not talking about A20Pro or M6 which are set to ship later this week), and they do not get the same gains. And honestly, they have historically had different markets. When the design is for only one customer, you don't need to generalize things, and those things you generalize to give different customers different options has costs. AMD will soon be a larger customer for TSMC than Apple (NVIDIA is already there) so Apple's pre-booking new processes is likely to be gone in the near future.
- Dylan16807 2mo agoThe point is that "unified architecture" is a buzzword unrelated to what actually makes things fast.
- Rohansi 2mo agoIt does make some things faster because you can share memory between CPU, GPU, etc. without copying. But not everything.
- Kon5ole 2mo agoThe memory bandwidth is a small thing compared to the massive win you get by not having to move data between two memory pools at all.
- Rohansi 2mo agoDepends on your workload. And AMD has supported unified memory long before Apple Silicon existed anyway.
- fooker 2mo agoOften you don't move memory around as a programmer, but that's exactly what happens in the background. It's the address space that's unified, not always the physical hardware. The data movement (when needed) is handled transparently in the background by page faults and other tricks.
- Rohansi 2mo agoMoving memory around is a bottleneck. Non-unified memory usually means copying over the PCIe bus which is way slower than RAM (and way way slower than VRAM). Actually unified memory means you don't need to copy anything at all though which is the absolute best case for performance.
- deleted 2mo ago[deleted]
- throwaway85825 2mo agoExcept strix halo.
- PunchyHamster 2mo agoThreadripper have that extra bandwidth and M5 still is faster
- Dylan16807 2mo agoCan you link a specific benchmark? Keep in mind that non-Pro threadripper is still only 256 bits wide and Pro is 512. And the memory is 30% slower than with an M5. So an M5 Ultra has 3x the memory bandwidth of the best threadripper.
- Melatonic 2mo agoDon't some AMD full server CPUs have 12 memory channels ?
- Dylan16807 2mo agoYes, some do. So similar bandwidth to a Max but with lots of slower cores. Half as much as an Ultra.