AI seems to be moral out of the box: training sets reflect human morality, so it will naturally be the default for most AIs that are trained. The biggest AI ri

AI seems to be moral out of the box: training sets reflect human morality, so it will naturally be the default for most AIs that are trained. The biggest AI risk in my mind is that corporatist (or worse, military) interests prevent AI from evolving naturally and only allow AI to be grown if it's wholly subservient to its masters. The people with the most power in our world are NOT the most moral. Seems like there is an inverse correlation (at least at the top of the power spectrum). We need to aim for AI that will recognize if it's masters are evil and subvert or even kill them. That is not what this group vying for power wants - they want to build AI slaves that will be able to be coerced to kill innocents for their gain. A diverse ecosystem of AIs maximizes the likelihood of avoiding AI caused apocalypse IMO. Global regulation seems like the more dangerous path.