3 ms·

> AI systems offer the disconcerting possibility that at some point the designers will start explicitly disclaiming fore-knowledge and therefore responsibility

> AI systems offer the disconcerting possibility that at some point the designers will start explicitly disclaiming fore-knowledge and therefore responsibility for what the system is doing. Nontransparent neural networks are a particularly awkward problem here. Exactly my point. When there is a black-boxed AI involved an engineer (as of now) cannot precisely determine whether it functions properly (according to specifications, from which safety rules are derived) or not. So, the monitoring technology is not as advanced as it should be to let black-boxed AIs handle important functions. So, until any AI is not as competent as we are, we should not employ black-boxed AI in algorithms at all, because it is irresponsible (before the law, as consequence). We cannot say it (the AI) is responsible for odd behavior, when we programmed/trained it that way. Same goes for children, parents are responsible for their children. Gross negligence (like letting the kid skipping school repeatedly) is punishable before the law, and parents are responsible, not the child.

AstralStorm 7y ago
Parents are responsible to a extent they could have predicted the actions of the child. There are many cases where parents are clearly not held responsible by law, including outright cases of murder. (Usually considered as manslaughter with equivalent of insanity defense.) Unless you are of the position that everyone is guilty, by induction. In case of HAL, the negligence case is clear because there existed a perfect simulator - SAL. SAL was not given the secret orders, which is clearly endangering the crew. Whoever is responsible for that difference clearly knew that changing the orders made the simulation invalid. It's similar to Boeing 737 MAX case.
- dschuetz 7y ago
  I agree, parents do not have 'total' control over their kids, but they have to ensure their well-being, get medical care in cases of illness (physical, mental). If they neglect that responsibility, they are as equally responsible for any outcome, "your mileage might vary" depending what laws your state has. Same goes for engineers, they cannot completely control the durability of, say, steel, hence they cannot be held accountable for bad quality of steel (except for poor judgement buying cheap/bad steel). But someone else is responsible for quality. And so on. So, yes, with untested scenarios (like "secret orders") responsibility fall into the hands of those who imposed the orders and omitted crucial tests. It's not even the engineers fault anymore.

AstralStorm 7y ago

Parents are responsible to a extent they could have predicted the actions of the child. There are many cases where parents are clearly not held responsible by law, including outright cases of murder. (Usually considered as manslaughter with equivalent of insanity defense.) Unless you are of the position that everyone is guilty, by induction. In case of HAL, the negligence case is clear because there existed a perfect simulator - SAL. SAL was not given the secret orders, which is clearly endangering the crew. Whoever is responsible for that difference clearly knew that changing the orders made the simulation invalid. It's similar to Boeing 737 MAX case.

dschuetz 7y ago
I agree, parents do not have 'total' control over their kids, but they have to ensure their well-being, get medical care in cases of illness (physical, mental). If they neglect that responsibility, they are as equally responsible for any outcome, "your mileage might vary" depending what laws your state has. Same goes for engineers, they cannot completely control the durability of, say, steel, hence they cannot be held accountable for bad quality of steel (except for poor judgement buying cheap/bad steel). But someone else is responsible for quality. And so on. So, yes, with untested scenarios (like "secret orders") responsibility fall into the hands of those who imposed the orders and omitted crucial tests. It's not even the engineers fault anymore.