4 ms·

The problem is that any race gets increasingly powerful as technology and science improve, so it takes a smaller and smaller mistake to end us all. Also, the po

The problem is that any race gets increasingly powerful as technology and science improve, so it takes a smaller and smaller mistake to end us all. Also, the population of those who are able to end us increases. Right now very few people have the ability to save or destroy us. One day every human might be able to, unless we hand the keys to the robots and we aren't certain how that'll play out. Edit: and we affect our environment more, which is always a battle with our level of understanding to manage that. Right now it's the climate. One day it could be the sun.

rl3 10y ago
>Right now very few people have the ability to save or destroy us. One day every human might be able to, unless we hand the keys to the robots and we aren't certain how that'll play out. Ironically one of the more likely ways an individual could end humanity (in the future) is via the haphazard or malicious creation of said robots. If all it takes is someone to execute a bootstrapping process on a large amount of computers, we're in trouble. There's no 100% reliable way to prevent that short of what you said: handing over the keys. It would require the creation of an entity so omnipotent and powerful that it may as well be considered a god. Another way to look at it is the creation of an operating system kernel for humanity itself, with each individual human being akin to a user-land process.