2 ms·
Here's what companies are trying to do: replace people with "AI". Why? Because people are annoying. They demand wages, breaks, medical care and so on. Of course
by jmyeet 3y ago
Here's what companies are trying to do: replace people with "AI". Why? Because people are annoying. They demand wages, breaks, medical care and so on. Of course what happens to companies when there's no one left being paid to afford their services never enters the picture.
Here's what companies should be doing: using AI to easy the work of their workers.
What's the difference? Well, in this case, closing an account is a serious action. It should always require human review. Mistakes do happen. Bugs happen. So, automated systems should simply allow one person to review many more accounts and/or to require less time to review such actions.
Companies should always be responsible for the consequences of these automated actions including all damages plus punitive damages. Want to know how this can go (and has gone) horribly wrong?
Hertz had an automated system that was falsely reporting rental cars as stolen [1]. People were charged and spent time in jail for this (eg [2]).
This should never happen. Any police report like this should require human review where the human is responsible for the consequences of that. Automated system or not, Hertz made false police reports. That's a crime. Or it should be if it isn't.
We are rapidly heading towards a dystopian future where ordinary life is impossible and nobody knows why because none of these systems explain why you're being imprisoned and your money has been seized.
[1]: https://www.npr.org/2022/12/06/1140998674/hertz-false-accusation-stealing-cars-settlement https://www.npr.org/2022/12/06/1140998674/hertz-false-accusa...
[2]: https://www.cbsnews.com/news/former-marine-arrested-charged-hertz-falsely-accused-him-stealing-rental-car/ https://www.cbsnews.com/news/former-marine-arrested-charged-...