3 ms·
Current GPUs have a comparable number of transistors (92.2 billion in the current NVidia Blackwell according to https://chipsandcheese.com/p/blackwell-nvidias-m
by noelwelsh 1y ago
Current GPUs have a comparable number of transistors (92.2 billion in the current NVidia Blackwell according to https://chipsandcheese.com/p/blackwell-nvidias-massive-gpu https://chipsandcheese.com/p/blackwell-nvidias-massive-gpu) to the number of neurons in human brains (about 90 billion according to Wikipedia). Brains consume less energy and do more, though transistors beat them on density. This suggests there are alternative pathways to performing computation that will scale better.
- jojobas 1y agoIt takes many transistors to replicate a single neuron, they work very differently in terms of speed, there is no direct comparison.
- noelwelsh 1y agoLet me restate. The article is musing about medium terms difficulties on the current pathway for producing computation. I'm musing that perhaps we are on the wrong pathway for producing computation.
- BriggyDwiggs42 1y agoThis only applies to functions of the brain which we wish to replicate on computers, not to those computers already outperform us on.
- noelwelsh 1y agoAgreed.
- jojobas 1y agoThat's the best we have, and not for lack of trying. There are attempts at analog inference (like Mythic) but it doesn't look as they are going anywhere yet.