4 ms·
I think the only defense against superintelligent AI doom is superintelligent AI thinking about how to prevent AI doom. Fewer projects with concentrated contro
by cwkoss 3y ago
I think the only defense against superintelligent AI doom is superintelligent AI thinking about how to prevent AI doom.
Fewer projects with concentrated control is thus more dangerous than a diversity of projects: the majority of AI wont want to destroy the planet or all humans, and will thus fight the ones that do.
- NovaDudely 3y agoI wouldn't say that very many, if any projects would set out to destroy the world. The vast majority of people are out to set the world right even if that view is wildly different depending on the perspective. By that I mean a terrorist is seen as a freedom fighter depending on the angle. What I fear is that something innocuous will have wildly intended outcomes. A good example, it is thought that a part of the 2008 credit crash was caused by algorithms handling all the bundling of securities. In bundling bad debt with good, it could hide a lot of the risk in the system. It comes down to the whole issue of trying to define the environment in which we deploy these things, defining the goals and hoping there are no gaps that the system can exploit in optimizing for outcome.
- cwkoss 3y agoWhat better to predict wildly unintended outcomes than another AI?