3 ms·
Our own psychology and moral intuition will cause us to attribute a higher responsibility to the AI failures even of we can prove numerically that humans would
by ithkuil 5y ago
Our own psychology and moral intuition will cause us to attribute a higher responsibility to the AI failures even of we can prove numerically that humans would have done more harm in average; all it takes is a few cases where a human would/could have saved the day
- ClumsyPilot 5y agoWe understand human failure and how to guard against it - we dont let drunk people drive, we require multiple authorisations to move a billion dollar or launch nukes, etc. We don't understand AI failure, so it can cause collosal damage at the worst possible time
- catlifeonmars 5y agoAnd yet, drunk people drive and kill themselves and other people every day. We may understand human failure, but we’re still really bad at mitigating it.
- ithkuil 5y agoHere is where our moral instincts make the difference. When mitigation fails we fallback on taking solace in a mechanism that plays a role in the mitigation aspect but its psychological effect takes a life of its own: punishment. When a human makes a fatal mistake it bears the responsibility of that mistake and we have protocols to put in place to deal with that (including having somebody to blame and direct our anger against). When a machine does a mistake it becomes much much unclear against whom direct our anger. The engineers who built it? The corporation that profited from it and could have invested more?