6 ms·
If you aren't compute bound, most workloads are dictated by the speed of main memory. And most business workloads spend their time waiting. Intel has historical
by sitkack 6y ago
If you aren't compute bound, most workloads are dictated by the speed of main memory. And most business workloads spend their time waiting. Intel has historically focused on single core performance, this is what they are _really_ good at while this graviton part has decided to go wide and focus on many core.
The memory controller on the ARM part must be excellent given that the Intel machine had 2x sockets.
I don't think a core to core comparison or core to hyperthreaded core makes much sense. There are so many other unknowns, they only appear to be similar metrics. $/work_unit is the benchmark I would focus on in case like object storage.
- deleted 6y ago[deleted]
- api 6y agoYes, and it's sort of apples and oranges for that reason. What it does show is that lots of cores may be much better for this type of work load.
- CalChris 6y agoGraviton isn't Arm IP. It's AWS ne Amazon IP. Amazon is an Arm architecture licensee. That's important because ... Arm capitalization: $ 31.6B Intel capitalization: $ 272.4B Amazon capitalization: $1240.0B Amazon can throw an insane amount of money at a problem when the want to. Edit to add: a good source for how much the Arm IP Graviton2 uses which is more than I thought: https://www.anandtech.com/show/15578/cloud-clash-amazon-graviton2-arm-against-intel-and-amd https://www.anandtech.com/show/15578/cloud-clash-amazon-grav... The DDR4-3200 memory controllers are probably licensed IP.
- baybal2 6y ago> Amazon can throw an insane amount of money at a problem when the want to. Take a look on what's happening with Chinese state backed semi companies. Sure surely have money. See how well the strategy of "just throw $100B on the problem" worked for them. It didn't. Chipmaking is a harder thing to do than to run cat video websites, or a web hosting business.
- parhamn 6y agoAs an outsider, I’d guess the biggest impact is the ability to buy chipmaking talent. That would certainly be easier for the American tech giants, no?
- saagarjha 6y agoPerhaps this might’ve helped? https://en.wikipedia.org/wiki/Annapurna_Labs https://en.wikipedia.org/wiki/Annapurna_Labs
- rapsey 6y agoWell to be honest how much of the money was actually well spent and not used to line someones pockets.
- dev_tty01 6y agoIf they spent $350 million to create a strategic advantage for their $35 billion AWS business it is money well spent.
- pranith 6y agoGraviton2 is using Ares core IP from ARM.
- neximo64 6y agoAll the market capitalisation shows is the closer you are to the customer in the supply chain the more value you can derive. Also, Market cap isn't cash. Amazon could not recreate Arm despite their market cap.
- rrss 6y agoGraviton 2 uses off the shelf Neoverse N1 cores designed by ARM. > Amazon is an Arm architecture licensee. Do you have a source for this, or is this conjecture? As far as I can tell, neither Amazon nor ARM have announced that Amazon has an architecture license.
- byefruit 6y agoMy money would be on greater memory bandwidth and probably better use of that bandwidth. If you look at the big graph later on in the article, even for similar _physical_ core counts the Graviton does better than the Skylake - this implies there's another bottleneck. It's worth pointing out as well that ARM's weaker memory model gives it many more opportunities for aggressive optimisations that can make better use of the available bandwidth.
- kllrnohj 6y ago> even for similar _physical_ core counts the Graviton does better than the Skylake - this implies there's another bottleneck. It doesn't, though, not until Skylake has already hit a bottleneck & graviton2 can eventually "catch up". Skylake caps out at around 12 cores, at which point performance goes flat & even regresses. At 12 cores, though, skylake has a huge lead over a 12 core Graviton2. Similarly, Cascade Lake caps out at around 18 cores. But again at 18 cores the gap between Cascade Lake & Graviton2 is huge. The bottleneck in play here is most likely memory bandwidth. The Graviton2 chip has 8-channel DDR4-3200 memory for a theoretical bandwidth of 204GB/s. That's going to be far more than any single CPU Xeon currently on the market. By comparison the Skylake would be 6 channel DDR4-2666 and Cascade Lake 6 channel DDR4-2933. So for this particular test the interesting comparison would be against Epyc Rome, which is also 8 channel DDR4-3200 and is up to 64 physical cores.
- StillBored 6y agotwo words, "NUMA binding". The cross socket NUMA bandwidth is like a tiny straw. If the OS or application is failing to pin the memory, cpu and IO together on the correct numa node your going to have a major scalability problem. So, two things can really throw this off, having a Physical->VM topology mismatch, or using a language that is garbage collected and won't allow the programmer to control memory/node placement. I've literally gotten 10x perf improvements by fixing these kinds of problems in the past. Combined with comparing cores to threads and the results are somewhat predictable. In this way, the simpler gravaton topology is really going to shine for applications that don't scale well. That is until intel builds an actual high core count single socket machine.
- wolf550e 6y agoGraviton 2 has a lot of memory bandwidth. See here: https://travisdowns.github.io/blog/2020/05/13/intel-zero-opt.html#hardware-survey https://travisdowns.github.io/blog/2020/05/13/intel-zero-opt...