3 ms·
There's always someone out there claiming Moore's law to be dead. It never is. Chiplets and chip stacking in particular have enabled big increases in transist
by timschmidt 2y ago
There's always someone out there claiming Moore's law to be dead. It never is. Chiplets and chip stacking in particular have enabled big increases in transistor count without associated downsides like decreased yield. So long as there is innovation and competition in the semiconductor industry, density / $, which you correctly point out was Moore's original metric, will continue to increase.
The potential for increasing performance and decreasing cost of LLM inference is even higher than Moore's law suggests, as the algorithms improve and are pushed closer to ideal hardware to run them.