Correct. These are relatively incremental improvements. And I would argue that recently they are more relevant in GPUs anyway due to the scalability. To resume

Correct. These are relatively incremental improvements. And I would argue that recently they are more relevant in GPUs anyway due to the scalability. To resume "Moore's Law" at the pace it once was, we need some of the truly new paradigms to mature. Ideas like memristors or optical transistors. You could even imagine something like a ubiquitous transparent P2P background computing grid as a big shift in software that could matter. But for hardware, the next paradigm that brings a few orders of magnitude boost to the baseline is going to actually be a.. different paradigm.