3 ms·
Both EPYC and Intel Skylake-X are NUMA. Yes, Skylake-X. It turns out that the placement of those L3 caches matter, and some cores are closer to some memory con
by dragontamer 5y ago
Both EPYC and Intel Skylake-X are NUMA.
Yes, Skylake-X. It turns out that the placement of those L3 caches matter, and some cores are closer to some memory controllers than others.
https://software.intel.com/content/www/us/en/develop/articles/intel-xeon-processor-scalable-family-technical-overview.html https://software.intel.com/content/www/us/en/develop/article...
------------
Some cores have lower latency access to some memory channels than other memory channels. Our modern CPUs are so big, that even if everything is on a singular chip, the difference in latency can be measured.
The only question that matters is: what is the bandwidth and latencies of _EACH_ core compared to _EACH_ memory channel? The answer is "it varies". "It varies" a bit for Skylake, and "it varies a bit more" for Rome (Zen 2), and "it varies a lot lot more" for Naples (Zen1).
---------
For simplicity, both AMD and Intel offer memory-layouts (usually round-robin) that "mixes" the memory channels between the cores, causing an average latency.
But for complexity / slightly better performance, both AMD and Intel also offer NUMA-modes. Either 4-NUMA for AMD's EPYCs, or SNC (Sub-numa clustering) for Intel chips. There are always a set of programmers who care enough about latency/bandwidth to drop down to this level.
- monocasa 5y agoIt looks like the parent edited the context out of their post. They were specifically calling out EPYC's extreme NUMAness, in contrast to Intel's, as the cause of their problems. That distinction has more or less been fixed since Zen 2, to the point that the NUMA considerations are basically the same between Intel and AMD (and really would be for any similar high core count design).
- jeffbee 5y agoDon't blame me for editing out something you imagined. I didn't touch it. If you're having problems with hallucinations and memory see a neurologist.