3 ms·
People don't really consider the immense risk of "speed superintelligences" as a very quick and relatively easy follow-on step to the development of AGI. Once
by mrshadowgoose 4y ago
People don't really consider the immense risk of "speed superintelligences" as a very quick and relatively easy follow-on step to the development of AGI.
Once developed, one solely needs to turn up the execution rate of an AGI, which would result in superhuman performance on most practical and economically meaningful metrics.
Imagine if for every real day that passed, one experienced 100 days of subjective time. Would that person be able to eclipse most of their peers in terms of intellectual output? Of course they would. In essence, that's what a speed superintelligence would be.
When most people think of AI outperforming humans, they tend to think of "quality superintelligences", AIs that can just "think better" than any human. That's likely to be a harder problem. But we don't even need quality superintelligences to utterly disrupt society as we know it.
We really need to stop arguing about time scales for the arrival of AGI, and start societal planning for its arrival whenever that happens. We likely already have the computational capacity for AGI, and have just not figured out the correct way to coordinate it. The human brain uses about 20 watts to do its thing, and humanity has gigawatts of computational capacity. Sure, the human brain should be considered to be "special purpose hardware" that dramatically reduces energy requirements for cognition. By a factor of more than 10^9 though? That seems unlikely.
- elcomet 4y agoThe energy used for "training" and getting to the current human brain was huge though if you consider evolution as part of it. Billions of living beings for billion of years.
- dinosaurdynasty 4y agoAnd evolution is horribly inefficient. It can probably be done with many orders of magnitude less compute.
- lagrange77 4y ago> We really need to stop arguing about time scales for the arrival of AGI, and start societal planning for its arrival whenever that happens. I think so, too.