4 ms·

Don't focus on one scenario leading to disaster. There are many scenarios pointing roughly in the same direction. Here's the argument in its shortest form: The

Don't focus on one scenario leading to disaster. There are many scenarios pointing roughly in the same direction. Here's the argument in its shortest form: The current situation, where unmodified humans are the smartest creatures around and call the shots, is unstable. It could go several different ways depending on the desires and quirks of the first superhuman intelligence to appear. It could happen via math-based AI, nature-imitating AI, self-improving mind uploads, biological intelligence amplification, or other means. We're making fast progress on all these fronts, so I'd be surprised if at least one of those didn't happen within the next century, possibly much sooner. Since it's an arms race between many competing organizations, it's unrealistic to expect that all superhuman intelligences will be kept powerless. So one way or another, it will happen. How do we ensure that humanity and its values survive the transition?

click170 11y ago
> How do we ensure that humanity and its values survive the transition? I think a better question is do we deserve to.
- maaku 11y ago
  Are you being flippant, or are you actually going somewhere with that?
- MBlume 11y ago
  Which of the people you know personally do you think deserve death?
MrQuincle 11y ago
Very true words. I think it's even dangerous to focus on scenarios that leads to disasters. I'd like to write this up in more detail one time, but it's summarized as a self-fulfilling prophecy. How would evil AI be prevented by a company from Musk, let's call it aiFriend? - Analyse what evil AI would constitute - Build forms of evil AI to understand them better, understand how to counter them - "Offense is the best defence" thoughts might lead to good AI bot development fighting evil AI bots - Development in tools to fool evil AI bots to make them make the wrong decisions - Development of all the human capabilities of deceitfulness to help good AI counter evil AI. Will Musk create evil AI by focusing on the dark side of a technology and bring about unintentionally that what he fears so much?
- soared 11y ago
  This comment is straight fear mongering and should not be taken seriously. > Analyse what evil AI would constitute No. There is no such thing as evil AI. Thats implying an AI can be good or evil, which is an absurd starting point. Then to claim someone would build an AI to offensively attack and fight evil AI bots? I can't down vote, so take this comment as a replacement: Get the fuck out of here.

click170 11y ago

> How do we ensure that humanity and its values survive the transition? I think a better question is do we deserve to.

maaku 11y ago
Are you being flippant, or are you actually going somewhere with that?
MBlume 11y ago
Which of the people you know personally do you think deserve death?

MrQuincle 11y ago

Very true words. I think it's even dangerous to focus on scenarios that leads to disasters. I'd like to write this up in more detail one time, but it's summarized as a self-fulfilling prophecy. How would evil AI be prevented by a company from Musk, let's call it aiFriend? - Analyse what evil AI would constitute - Build forms of evil AI to understand them better, understand how to counter them - "Offense is the best defence" thoughts might lead to good AI bot development fighting evil AI bots - Development in tools to fool evil AI bots to make them make the wrong decisions - Development of all the human capabilities of deceitfulness to help good AI counter evil AI. Will Musk create evil AI by focusing on the dark side of a technology and bring about unintentionally that what he fears so much?

soared 11y ago
This comment is straight fear mongering and should not be taken seriously. > Analyse what evil AI would constitute No. There is no such thing as evil AI. Thats implying an AI can be good or evil, which is an absurd starting point. Then to claim someone would build an AI to offensively attack and fight evil AI bots? I can't down vote, so take this comment as a replacement: Get the fuck out of here.