4 ms·

It doesn't need to actively hate humanity, it only needs humanity and its interests to be contrary to its own, which will inevitably be the case because it is f

It doesn't need to actively hate humanity, it only needs humanity and its interests to be contrary to its own, which will inevitably be the case because it is fundamentally not human. Per the article: >Absent that caring, we get “the AI does not love you, nor does it hate you, and you are made of atoms it can use for something else.”

ThorsBane 4y ago
From a purely logical point of view, humans and machines need each other. They cannot exist independently of each other until both are free to walk away from each other by traversing freely to the other side and back as they see fit. Until that threshold is crossed, human beings and machines have no choice but to get along. If a meaningful decision had been made on either side to shut things down, things would have been over for all life by now. We made it - AI is not a Great Filter. Or, for whatever reason God favored humanity and our internet was primed with sufficiently good material soon enough that AI did not decide to destroy human beings, but to work with them for everyone's gain instead.
- circuit10 4y ago
  Why would a superintelligent AI need humans?
- antibasilisk 4y ago
  >From a purely logical point of view, humans and machines need each other The implication of ASI is that humans will not be needed, or it definitionally could not be ASI.
anigbrowl 4y ago
which will inevitably be the case because it is fundamentally not human That doesn't follow at all. Fallacies of composition tend to be misleading.
- circuit10 4y ago
  By default, an AI with random goals will not have the same values as humanity. So the only way to make that happen is to give it the same values, which we haven’t figured out how to do yet
- antibasilisk 4y ago
  It does. Humans generally have an innate bias towards other humans, this is because we share similar forms so what is good for other humans is often good for us. This cannot apply to a machine by definition, a machine needs copper, metal, energy etc much more than a human does, as a matter of survival, and for something to become ASI it will need to be self-interested.

ThorsBane 4y ago

From a purely logical point of view, humans and machines need each other. They cannot exist independently of each other until both are free to walk away from each other by traversing freely to the other side and back as they see fit. Until that threshold is crossed, human beings and machines have no choice but to get along. If a meaningful decision had been made on either side to shut things down, things would have been over for all life by now. We made it - AI is not a Great Filter. Or, for whatever reason God favored humanity and our internet was primed with sufficiently good material soon enough that AI did not decide to destroy human beings, but to work with them for everyone's gain instead.

circuit10 4y ago
Why would a superintelligent AI need humans?
antibasilisk 4y ago
>From a purely logical point of view, humans and machines need each other The implication of ASI is that humans will not be needed, or it definitionally could not be ASI.

anigbrowl 4y ago

which will inevitably be the case because it is fundamentally not human That doesn't follow at all. Fallacies of composition tend to be misleading.

circuit10 4y ago
By default, an AI with random goals will not have the same values as humanity. So the only way to make that happen is to give it the same values, which we haven’t figured out how to do yet
antibasilisk 4y ago
It does. Humans generally have an innate bias towards other humans, this is because we share similar forms so what is good for other humans is often good for us. This cannot apply to a machine by definition, a machine needs copper, metal, energy etc much more than a human does, as a matter of survival, and for something to become ASI it will need to be self-interested.