17 ms·
> There's value in having the same compute ability in fewer cores. Communication/synchronization overhead is usually growing faster than linear in the number of
by dragontamer 6y ago
> There's value in having the same compute ability in fewer cores. Communication/synchronization overhead is usually growing faster than linear in the number of threads.
I agree for sure. But the tradeoffs are pretty steep. Scaling within a core is traditionally sqrt(size), while scaling number of cores on a problem is also sqrt(cores).
Balancing between size-of-core vs number-of-cores is a big question. And that also depends very strongly on the task at hand. Web-servers scale better than sqrt(#cores), because each worker-thread is basically fully independent.
> I don't think we'll see Intel and AMD increase the width of their cores so much; they need their cores to scale to 5Ghz (even if it takes 1KW of cooling) for marketting and competition reasons, and wider cores are harder to clock so high.
I think there's a good argument that AMD / Intel can't scale their decoder much larger than 4-way / 6-way with uOp cache, due to the instruction set issue.
But I've seen some interesting innovations: the most recent Intel Atoms have double-decoders (2+2 decoder) on SMT-based Atoms. Such a thing would make SMT more efficient without much increase to power.
Its strange to see Apple take the single-thread performance crown. But... I don't think they've proven themselves in the high-end server / workstation market yet. Even if they do scale up, their decisions don't seem to be an obvious winner at the high end.