3 ms·
I have heard Moore’s law generalized to “computing power doubles every two years” which could then apply to “AI”
by colejohnson66 6y ago
I have heard Moore’s law generalized to “computing power doubles every two years” which could then apply to “AI”
- DiogenesKynikos 6y agoThere's a subtle difference, though. Moore's law benefits all applications, by increasing performance across the board. This new "Huang's law" increases performance for certain critical applications, while presumably decreasing performance of other applications (at fixed cost). The difference is generally increasing transistor density vs. specializing hardware to perform critical tasks (like graphics rendering or tensor algebra).
- CyberDildonics 6y agoThat's not a generalization, it's a misunderstanding. Not every program can benefit from doubling transistors because not every program is written to minimize serial computations and the impact of memory latency. The reason Moore's law was insightful was because he didn't make the simplistic generalization of computing power (which is more difficult to quantify anyway) and looked at what was really happening on a fundamental level from an engineering perspective.