3 ms·

AIs without human morality, which would put certain restrictions on them, will likely have less power in the long run. This I agree and the consequences could

AIs without human morality, which would put certain restrictions on them, will likely have less power in the long run. This I agree and the consequences could be dire if we do nothing to prevent that. Thus, the onus is on us to first develop AIs with moral core and a regulatory framework which incorporates our best knowledge from sciences and humanities, then task the moral AIs to help regulate the development of amoral ones. As a side note, although many details of human morality are not completely consistent across cultures, there are many shared tenets. Some examples: "Do not kill one of your own who did not do something wrong." "Avoid incest." "Do not steal." Current crops of AIs are not even aware of such common sense.

pixl97 9y ago
Take "Avoid incest" for example, this is a human genealogical construct that does not map well to the machine experience. In humans too much inbreeding leads to accumulation of negative traits. In AI this is called over specialization. So, by those metrics, good AI learning systems already avoid that. >"Do not kill one of your own who did not do something wrong." Also is a very human subjective experience. We see the individual as the quantum of pain and experience and optimize on that. In the AI world killing off other AI that don't stand out as better than a baseline may be an optimal evolutionary strategy. Also "Do not steal" is a terrible human morality baseline with a highly subjective gradient. Did you borrow a pen and not give it back, is that not technically theft? Is a business transaction where you used secret information to gain monetary advantage other the other party theft or not? The problem with your first statement is you assume that human morality is the pinnacle of morality and all other forms will be lesser to that standard. This could lead to significant disruption for humanity of a more efficient or optimized form of morality comes along.
- nopinsight 9y ago
  The examples of moral codes I gave were not meant to be used on AIs but by AIs working for/with humans. > The problem with your first statement is you assume that human morality is the pinnacle of morality and all other forms will be lesser to that standard. To be clear, my first statement was meant to read as: "AIs without human morality, which would put certain restrictions on them, will likely have less power than amoral AIs in the long run." And "power" here means the ability to effect things in the world. I did not assume that human morality is the pinnacle. I agree with you that it is likely not an optimized one. My whole argument rests on the principle that AIs that do not incorporate human morality into its utility calculus will have negative consequences on us.
  - pixl97 9y ago
    And this goes back to my original statement that AI will eventually evolve past it. AI will originally be the weak 'force'. It will have to evolve mimicry to survive. This will lead to an increase of its survivability in a human dominated world. Eventually this will lead to AI being the dominant 'lifeform'. It is at this point a rapid cascade to a machine oriented morality can occur, and I can't imagine that it would be good for the human species as a whole.

pixl97 9y ago

Take "Avoid incest" for example, this is a human genealogical construct that does not map well to the machine experience. In humans too much inbreeding leads to accumulation of negative traits. In AI this is called over specialization. So, by those metrics, good AI learning systems already avoid that. >"Do not kill one of your own who did not do something wrong." Also is a very human subjective experience. We see the individual as the quantum of pain and experience and optimize on that. In the AI world killing off other AI that don't stand out as better than a baseline may be an optimal evolutionary strategy. Also "Do not steal" is a terrible human morality baseline with a highly subjective gradient. Did you borrow a pen and not give it back, is that not technically theft? Is a business transaction where you used secret information to gain monetary advantage other the other party theft or not? The problem with your first statement is you assume that human morality is the pinnacle of morality and all other forms will be lesser to that standard. This could lead to significant disruption for humanity of a more efficient or optimized form of morality comes along.

nopinsight 9y ago
The examples of moral codes I gave were not meant to be used on AIs but by AIs working for/with humans. > The problem with your first statement is you assume that human morality is the pinnacle of morality and all other forms will be lesser to that standard. To be clear, my first statement was meant to read as: "AIs without human morality, which would put certain restrictions on them, will likely have less power than amoral AIs in the long run." And "power" here means the ability to effect things in the world. I did not assume that human morality is the pinnacle. I agree with you that it is likely not an optimized one. My whole argument rests on the principle that AIs that do not incorporate human morality into its utility calculus will have negative consequences on us.
- pixl97 9y ago
  And this goes back to my original statement that AI will eventually evolve past it. AI will originally be the weak 'force'. It will have to evolve mimicry to survive. This will lead to an increase of its survivability in a human dominated world. Eventually this will lead to AI being the dominant 'lifeform'. It is at this point a rapid cascade to a machine oriented morality can occur, and I can't imagine that it would be good for the human species as a whole.