3 ms·
There's value in having the same compute ability in fewer cores. Communication/synchronization overhead is usually growing faster than linear in the number of t
by toast0 6y ago
There's value in having the same compute ability in fewer cores. Communication/synchronization overhead is usually growing faster than linear in the number of threads.
SMT isn't an unalloyed good, it helps for many workloads and hurts for some. That said, the very wide cores in M1 are asking for SMT to increass utilization, I'd guess it'll happen eventually. OTOH, the weaker memory consistency rules on ARM seem to allow for a lot more out of order execution, which seems to keep things busy.
I don't think we'll see Intel and AMD increase the width of their cores so much; they need their cores to scale to 5Ghz (even if it takes 1KW of cooling) for marketting and competition reasons, and wider cores are harder to clock so high.
- dragontamer 6y ago> There's value in having the same compute ability in fewer cores. Communication/synchronization overhead is usually growing faster than linear in the number of threads. I agree for sure. But the tradeoffs are pretty steep. Scaling within a core is traditionally sqrt(size), while scaling number of cores on a problem is also sqrt(cores). Balancing between size-of-core vs number-of-cores is a big question. And that also depends very strongly on the task at hand. Web-servers scale better than sqrt(#cores), because each worker-thread is basically fully independent. > I don't think we'll see Intel and AMD increase the width of their cores so much; they need their cores to scale to 5Ghz (even if it takes 1KW of cooling) for marketting and competition reasons, and wider cores are harder to clock so high. I think there's a good argument that AMD / Intel can't scale their decoder much larger than 4-way / 6-way with uOp cache, due to the instruction set issue. But I've seen some interesting innovations: the most recent Intel Atoms have double-decoders (2+2 decoder) on SMT-based Atoms. Such a thing would make SMT more efficient without much increase to power. Its strange to see Apple take the single-thread performance crown. But... I don't think they've proven themselves in the high-end server / workstation market yet. Even if they do scale up, their decisions don't seem to be an obvious winner at the high end.