4 ms·
Your point is true but it is too narrow. A similar argument was bandied about regarding the CPU clock which hit a wall which was defeated with multi-cores and
by shalabajser 2y ago
Your point is true but it is too narrow. A similar argument was bandied about regarding the CPU clock which hit a wall which was defeated with multi-cores and parallelization. The atom wall you are talking about is crushed with 3D semiconductors (hybrid bonding, wafer to wafer..., HBM), wafer scale CPUs like Cerebras, larger clusters, faster networking... Incidentally, massive parallelization suits AI just fine. Do you seriously think that computing power will stop growing? Ever?
- ahartmetz 2y agoI do think so. Every exponential growth is a sigmoid curve on a long enough timescale. The end of Moore's Law is here (for now) even with multicores and everything else, by the way. That you can get more compute by throwing more resources at the problem doesn't really count. The big deal about Moore's Law was that it was free. The 3D stuff, clusters, etc, can increase the number of transistors... but it's gonna cost proportionally more in fabrication and energy when running.