4 ms·
There's a word for this: computational intensity, i.e. the ratio of useful compute operations per memory load in an app. Are there are apps that have high comp
by eslaught 10y ago
There's a word for this: computational intensity, i.e. the ratio of useful compute operations per memory load in an app.
Are there are apps that have high computational intensity? Sure, matrix multiply is one of them. That's one of the reasons why dense linear algebra serves as the standard benchmark to determine the top 500 supercomputers in the world.
But even in HPC (high performance computing), many if not most apps actually have relatively low computational intensity (i.e. in the range of one or so compute operations per word of memory loaded). In this regime, it really doesn't make sense to grow compute out of proportion with memory bandwidth because you'll just be idling the processors.
And while I have no proof, I'd expect HPC applications to generally be more computationally intense than general consumer computing tasks. So I'd expect that computational intensity goes mostly down from here.