4 ms·
This article is more current than when it was written. We are deep into the Post-Moore's Law era, where a new generation gives, now, 120% rather than 200% of t
by ncmncm 7y ago
This article is more current than when it was written.
We are deep into the Post-Moore's Law era, where a new generation gives, now, 120% rather than 200% of the previous generation's performance. Next generation we might get 115% of this, or 110%.
Another consequence is that the improvements we get have become dodgier and less reliable, so that tiny, irrelevant-looking changes in the code may mean a 2x speedup, but more commonly a 2x slowdown. (This is in no way an exaggeration.) The bargain we get from pervasive penetration of more kinds of caches is that sometimes our programs are faster, but we no longer know how fast they should be, or whether another factor of two or ten has been left on the table.
Sorting algorithms are quite mature now, so that a 20% improvement in a relevant case is important, yet a factor of 2 or more may come from the compiler choosing one instruction over another.
Compiler regression bug reports now routinely complain of a 2x performance loss from that instruction choice, but fixing them would result in 2x losses in some other set of programs, instead. We get new unportable compiler intrinsics to patch the failure, that often don't, for obscure reasons.
- BubRoss 7y agoMoore's law was always about transistor density increases, not performance, and definitely not about serial performance in a single core, no matter how much people want to reframe it. Transistor density is still improving, just not as quickly and CPU speed is still increasing, just not on a single core.
- ncmncm 7y agoNot so. Earlier generations came with higher, often doubled clock speeds. Many programmers today have never seen such a doubling, yet policies still assume them.
- BubRoss 7y agoClock speeds have nothing to do with Moore's law, which was about transistor density. I'm not sure how you can say that a doubling in density hasn't happened when there are "7nm" 64 core CPUs out there. Transistor density has slowed but not stopped. Moore also predicted an exponential increase in price for density improvements which has also seemed to happen.
- ncmncm 7y agoPreviously, die shrinks enabled faster clocking. It is a shame you missed those days, but to deny they happened is just sad. We did not go from 1MHz 6502s to 4GHz Pentiums without a generous series of doublings. Twelve, in fact.
- BubRoss 7y agoI get that you are being intentionally condescending and obtuse here, but you were talking about 'the end of Moore's' law, which only talks about transistor density increases in addition to cost, and both of those are still increasing. Clock speeds, instructions per clock, cache, latency, prefetching, out of order execution and many other aspects of CPU performance were not the trend Gordon Moore outlined. You are conflating things that stem from transistor density with Moore's Law.
- ncmncm 7y agoWhile Moore's original, concise expression was in terms of transistor areal density, the faster clock rate was implied and expected, just as lower latency is implied by the faster clock. Thus, the stagnation of clock rates is rightly recognized as the beginning of its end. Allocation of the newly available transistors to caches, functional units, execution units, and ultimately extra cores was also implied: the transistors are not decorative: they are there to be used. With feature sizes approaching a single lattice unit cell, its final stage will be reached shortly. To insist that transistor count is the only point of Moore's Law is to be deliberately obtuse: it was the exactly the extra value provided by the extra transistors and the machinery built of them, and the faster clocks, that would (and did) generate the capital investment needed to develop each succeeding, more expensive, generation.
- BubRoss 7y agoThis is all rationalizing whatever you were trying to say about performance stalling. People only talk about 'the intent' when they realize they have been regurgitating news headlines and haven't looked any deeper. The point is that performance hasn't stalled at all just because clock rates aren't going up. Faster clocks are diminishing returns in performance due to memory latency. Transistor density was the point and performance is still increasing due to transistor density, even if you don't know how to use multiple cores.