4 ms·

Is there any point to such speculation? Just as much as that is true, so too could the AI succeed in similar scenarios where humans would fail. The same questio

Is there any point to such speculation? Just as much as that is true, so too could the AI succeed in similar scenarios where humans would fail. The same question could be asked about two humans being contrasted against each other, and just as fruitlessly.

bryanrasmussen 5y ago
https://www.bbc.com/future/article/20170410-how-to-fool-artificial-intelligence https://www.bbc.com/future/article/20170410-how-to-fool-arti... AI and humans fail in different ways.
- ithkuil 5y ago
  Our own psychology and moral intuition will cause us to attribute a higher responsibility to the AI failures even of we can prove numerically that humans would have done more harm in average; all it takes is a few cases where a human would/could have saved the day
  - ClumsyPilot 5y ago
    We understand human failure and how to guard against it - we dont let drunk people drive, we require multiple authorisations to move a billion dollar or launch nukes, etc. We don't understand AI failure, so it can cause collosal damage at the worst possible time
    - catlifeonmars 5y ago
      And yet, drunk people drive and kill themselves and other people every day. We may understand human failure, but we’re still really bad at mitigating it.
      - ithkuil 5y ago
        Here is where our moral instincts make the difference. When mitigation fails we fallback on taking solace in a mechanism that plays a role in the mitigation aspect but its psychological effect takes a life of its own: punishment. When a human makes a fatal mistake it bears the responsibility of that mistake and we have protocols to put in place to deal with that (including having somebody to blame and direct our anger against). When a machine does a mistake it becomes much much unclear against whom direct our anger. The engineers who built it? The corporation that profited from it and could have invested more?

bryanrasmussen 5y ago

https://www.bbc.com/future/article/20170410-how-to-fool-artificial-intelligence https://www.bbc.com/future/article/20170410-how-to-fool-arti... AI and humans fail in different ways.

ithkuil 5y ago
Our own psychology and moral intuition will cause us to attribute a higher responsibility to the AI failures even of we can prove numerically that humans would have done more harm in average; all it takes is a few cases where a human would/could have saved the day
- ClumsyPilot 5y ago
  We understand human failure and how to guard against it - we dont let drunk people drive, we require multiple authorisations to move a billion dollar or launch nukes, etc. We don't understand AI failure, so it can cause collosal damage at the worst possible time
  - catlifeonmars 5y ago
    And yet, drunk people drive and kill themselves and other people every day. We may understand human failure, but we’re still really bad at mitigating it.
    - ithkuil 5y ago
      Here is where our moral instincts make the difference. When mitigation fails we fallback on taking solace in a mechanism that plays a role in the mitigation aspect but its psychological effect takes a life of its own: punishment. When a human makes a fatal mistake it bears the responsibility of that mistake and we have protocols to put in place to deal with that (including having somebody to blame and direct our anger against). When a machine does a mistake it becomes much much unclear against whom direct our anger. The engineers who built it? The corporation that profited from it and could have invested more?