3 ms·
For context: A 4090 has 76 billion transistors, and the B200 superchip that Nvidia announced has around 200 billion transistors, on an absolutely enormous packa
by ls612 3y ago
For context: A 4090 has 76 billion transistors, and the B200 superchip that Nvidia announced has around 200 billion transistors, on an absolutely enormous package of 2 dies glued together ala the M2 Ultra. So this would suggest a minimum density increase of 5 times in the next 6 years. Moore's Law isn't dead yet folks.
- choilive 3y ago"Rumours of my demise have been greatly exaggerated". It feels like people have been harking the death of Moore's law for decades, I think we still got at least another decade to go just based on the technology we have today.
- mensetmanusman 3y agoIt is for cost and power density.
- ls612 3y agoPower Density seems to be scaling 1:1 for N5/4 to N3, with a 50% increase in transistors per mm^2 and a 33% reduction in power at the same performance (which when scaling horizontally means 50% more performance at the same power). Cost is another question, though it is still falling year over year in $/Mtr.