3 ms·
This highlights one of the hazards of a highly-automated future. A reason to put judges, purses, and other humans into the mix is to look for injustices and giv
by gumby 6y ago
This highlights one of the hazards of a highly-automated future. A reason to put judges, purses, and other humans into the mix is to look for injustices and give people the right to make ad hoc exceptions.
If a mechanical process were to, say, photograph you at a red light camera, ticket you, and perhaps automatically take the funds from your account you might have no recourse. And once we have such a can imagine worse with opaque ML models and few to no humans in the loop.
Of course the system we have is also ripe for abuse, and can be unthinkingly rigid as well (think of “Brazil”). But better than full automation.
- smileysteve 6y agoTo disagree; this highlights that manual systems are flawed, have inappropriate priorities - or at best have inappropriate resources in the process things manually. Imagine, if instead of a prosecutor adding this to a record, a computer did it and the prosecutor's office could spend time reviewing outstanding non violent charges.
- gumby 6y agoStill human-in-the-loop which I think is crucial. I was highlighting he drive to fully automated systems, as is increasingly the case in the private sector (due to sheer volume if nothing else).
- mshroyer 6y agoI agree we need humans in the loop for things like the administration of justice. But this is a case where humans _were_ in the loop yet acted like automatons themselves. They failed to apply the baseline level of judgment that would have stopped them filing felony charges for "embezzlement" of a VHS tape featuring a talking cat.
- grishka 6y agoThis exact thing is already happening with internet corporations. Google and Facebook can literally take away most of your digital life for you doing nothing wrong, and you'll have no recourse to get it back. You'll be hitting a wall of faceless automated replies saying that "your account will not be reinstated at this time and this decision is final".
- notdang 6y agoI don't pay taxes to Google and Facebook. I don't own them anything and they don't own me anything.
- gumby 6y agoI basically agree but it’s worth using some of what they do as a cautionary example when considering public administration. We willingly embrace inefficiency in government for some of these very reasons. I wrote “basically” because large companies that are deeply integrated into public life (nationally or locally — consider free speech requirements in shopping malls) reasonably deserve extra scrutiny at the very least. You don’t, in theory, pay taxes to your local electricity utility yet hey are far more controlled by public policy than, say, your local fruit stand. Unfortunately most discussions in government about FB or Google can most charitably be described as incoherent.
- grishka 6y agoThough this does happen to paying customers as well, for example Android app developers who pay 30% on their in-app purchases to Google. To a lesser extent this also happens to YouTube creators who get their videos wrongly removed because copyright and who are paid by Google for ads that appear on their videos.