> If the whole point of the technological singularity is that it is beyond our ability to understand it, how can we have an opinion on it? Some people here wo

> If the whole point of the technological singularity is that it is beyond our ability to understand it, how can we have an opinion on it? Some people here would probably enjoy this: https://www.gwern.net/Complexity%20vs%20AI#parable-of-the-worms https://www.gwern.net/Complexity%20vs%20AI#parable-of-the-wo... I can't understand seriously asking that question. There are infinite ways for some superintelligence to be misaligned with our goals, and very few ways for it go right. We're the one's building it, it's not some inevitable fate that we'll build a superintelligence who's motives/utility function is beyond us. Now is the time to think about it and get it right.