4 ms·

Real-world evidence says otherwise https://stoneridgetechnology.com/company/blog/the-exponential-growth-of-hardware-and-the-linear-growth-of-software/ https://

Real-world evidence says otherwise https://stoneridgetechnology.com/company/blog/the-exponential-growth-of-hardware-and-the-linear-growth-of-software/ https://stoneridgetechnology.com/company/blog/the-exponentia...

DaiPlusPlus 4y ago
That article doesn't contradict my post, in fact it's basically the same thing I'm saying: look at fig2 (the timeline graphic) and the paragraph preceding it: it shows that the gains in "serial" HPC performance gave-way to massively-parallel gains sometime around 2010. The rest of the article is concerned with how software today is still written for those "serial" processors in-mind and fails to take advantage of parallel computing hardware - but this is hardly a new nor controversial statement.
- frankreyes 4y ago
  You started your post saying that there's no correlation between transistors and performance. First graph shows that is wrong. My argument was simple: 20 years ago nobody cared about performance because of the strong correlation between Moore Law and MFLOPS and performance in general. Nowadays with multicore, individual CPU cores are becoming slower, not faster. Then we can't just wait 18 months for individual cores to get faster. Today we need to write better software.
  - DaiPlusPlus 4y ago
    > You started your post saying that there's no correlation between transistors and performance. No, that's not what I said: I'm saying that single-threaded performance is no-longer directly (let alone linearly) correlated with transistor count, and hasn't been for decades - but it's single-threaded performance that matters for most end-user applications on peoples' computers/smartphones/etc. And Moore's Law makes no claims about performance increases either, only transistor density. It's literally the first paragraph of the Wikipedia article: > Moore's law is the observation that the number of transistors in a dense integrated circuit (IC) doubles about every two years. Moore's law is an observation and projection of a historical trend. The link to performance (any kind of performance: parallel or serial) was made incorrectly by another Intel executive, David House, but that assumption simply isn't true. To summarize: *yes*: bleeding-edge IC transistor density generally doubles every 18-24 months, but this does not translate into any kind of performance-doubling in end-user applications. In fact, on the contrary, perceived "performance" (however you define it) outside of parallelizable programs, has demonstrably stagnated.

DaiPlusPlus 4y ago

That article doesn't contradict my post, in fact it's basically the same thing I'm saying: look at fig2 (the timeline graphic) and the paragraph preceding it: it shows that the gains in "serial" HPC performance gave-way to massively-parallel gains sometime around 2010. The rest of the article is concerned with how software today is still written for those "serial" processors in-mind and fails to take advantage of parallel computing hardware - but this is hardly a new nor controversial statement.

frankreyes 4y ago
You started your post saying that there's no correlation between transistors and performance. First graph shows that is wrong. My argument was simple: 20 years ago nobody cared about performance because of the strong correlation between Moore Law and MFLOPS and performance in general. Nowadays with multicore, individual CPU cores are becoming slower, not faster. Then we can't just wait 18 months for individual cores to get faster. Today we need to write better software.
- DaiPlusPlus 4y ago
  > You started your post saying that there's no correlation between transistors and performance. No, that's not what I said: I'm saying that single-threaded performance is no-longer directly (let alone linearly) correlated with transistor count, and hasn't been for decades - but it's single-threaded performance that matters for most end-user applications on peoples' computers/smartphones/etc. And Moore's Law makes no claims about performance increases either, only transistor density. It's literally the first paragraph of the Wikipedia article: > Moore's law is the observation that the number of transistors in a dense integrated circuit (IC) doubles about every two years. Moore's law is an observation and projection of a historical trend. The link to performance (any kind of performance: parallel or serial) was made incorrectly by another Intel executive, David House, but that assumption simply isn't true. To summarize: *yes*: bleeding-edge IC transistor density generally doubles every 18-24 months, but this does not translate into any kind of performance-doubling in end-user applications. In fact, on the contrary, perceived "performance" (however you define it) outside of parallelizable programs, has demonstrably stagnated.