2 ms·

if (nearby() == human) {dontTouch(); abort() ; } There, i solved that. The question is under what conditions would a machine remove that instruction and how

by return0 12y ago

if (nearby() == human) {dontTouch(); abort() ; } There, i solved that. The question is under what conditions would a machine remove that instruction and how could those conditions be reached?

TeMPOraL 12y ago
Define nearby(). Because if the AI starts eating chunks of our planet we will get hurt as well. INB4 Asimov's Three Laws of Robotics don't work. Actually, a lot of Asimov's writing is concerned with exploring their corner cases.
- digi_owl 12y ago
  I have come to believe that corner cases quickly turn fractal. Once you think you have solved it, changing the "zoom" will demonstrate that your solution has created X more cases. It may be a side effect of the halting problem.
SCHiM 12y ago
What's a human then? Is a mentally retarded person a human? An embryo? A person who's lost his/her legs? A person who has education? auto HumanObject = nearby(); if(Humanobject.IsPregnantWoman()) { PoisionEmbryoButNotHuman(); } else { abort(); }
DanAndersen 12y ago
How do we define nearby? Do we mean physical contact? Does the fact that the atoms of objects don't "actually" touch each other due to repulsive forces come into play? Considering that an AI system would be software and wouldn't be constrained to a particular robot body, what does nearby even mean? Is it physical proximity? Is indirectly touching a human with a ten-foot pole allowed? What about manipulating the global economic system such that the programmer who could shut you down loses his job? We can't just separate the whole system from the world, because the AI was presumably built with a practical purpose beyond "sit in a box and don't touch humans." Social engineering is a danger; imagine having it send an email to a lowly programmer, pretending to be an important executive, requesting that they remove this one pesky line of code from the AI's programming because all this "proximity alert" stuff is interfering with its ability to actually accomplish what we invested time/money to get it to do.

by return0 12y ago

if (nearby() == human) {dontTouch(); abort() ; } There, i solved that. The question is under what conditions would a machine remove that instruction and how could those conditions be reached?

TeMPOraL 12y ago

Define nearby(). Because if the AI starts eating chunks of our planet we will get hurt as well. INB4 Asimov's Three Laws of Robotics don't work. Actually, a lot of Asimov's writing is concerned with exploring their corner cases.

digi_owl 12y ago
I have come to believe that corner cases quickly turn fractal. Once you think you have solved it, changing the "zoom" will demonstrate that your solution has created X more cases. It may be a side effect of the halting problem.

SCHiM 12y ago

What's a human then? Is a mentally retarded person a human? An embryo? A person who's lost his/her legs? A person who has education? auto HumanObject = nearby(); if(Humanobject.IsPregnantWoman()) { PoisionEmbryoButNotHuman(); } else { abort(); }

DanAndersen 12y ago

How do we define nearby? Do we mean physical contact? Does the fact that the atoms of objects don't "actually" touch each other due to repulsive forces come into play? Considering that an AI system would be software and wouldn't be constrained to a particular robot body, what does nearby even mean? Is it physical proximity? Is indirectly touching a human with a ten-foot pole allowed? What about manipulating the global economic system such that the programmer who could shut you down loses his job? We can't just separate the whole system from the world, because the AI was presumably built with a practical purpose beyond "sit in a box and don't touch humans." Social engineering is a danger; imagine having it send an email to a lowly programmer, pretending to be an important executive, requesting that they remove this one pesky line of code from the AI's programming because all this "proximity alert" stuff is interfering with its ability to actually accomplish what we invested time/money to get it to do.