3 ms·
Some basic investigatory police work (the kind they did before AI) would have revealed the mistake before an innocent woman’s life was destroyed.
by nkrisc 7mo ago
Some basic investigatory police work (the kind they did before AI) would have revealed the mistake before an innocent woman’s life was destroyed.
- jqpabc123 7mo agoYes. But doing the investigation negates much of the incentive for using AI. Look for similar to play out elsewhere --- using unreliable tools for decision making is not a good, responsible business plan. And lawyers are just waiting to press the point.
- bornfreddy 7mo agoAI can provide leads. Someone still needs to verify them and decide.
- jqpabc123 7mo agoGenerating and verifying bad leads costs money. Not verifying bad leads can cost much more. At some point, you have to decide if wasting good money on bad intel makes sense.
- nkrisc 7mo agoIn this case it sounds as though AI could have been used to generate preliminary leads. When someone calls a tip line with information, police don’t just take their word for it, they investigate it. They know that tips they receive may be incorrect. They should have done the exact same here, but they didn’t. I’m very opposed to AI in general, but this one is clearly human failure. The noteworthy AI angle is the undeserved credence police gave to AI information. But that is ultimately their failure; they should be investigating all information they receive.
- jqpabc123 7mo ago...but this one is clearly human failure. Absolutely. The failure starts with tool vendors who market these statistical/probabilistic pattern searchers as "intelligent". The Fargo police failed to fully evaluate these marketing claims before applying them to their work. So in the same way that the failure rolled down hill, liability needs to roll back up.
- SpicyLemonZest 7mo agoThe article says that the Fargo police claimed to have done "additional investigative steps independent of AI". (Perhaps they're lying, or did a poor job because they thought the extra steps were a formality.)
- nkrisc 7mo agoGiven the actual outcome it’s hard to imagine what they actually did. It would be less embarrassing for them if they had said they did no additional investigating.
- SpicyLemonZest 7mo agoIt's not even the right question, really. If they found some crazy coincidence that genuinely seemed to corroborate the identification, it's still not OK that this woman was dragged across the country. They rightly identify that the initial AI scan was wrong to do even if everything that followed was by the book. Our law enforcement processes were developed in a context where this kind of error was much harder because there was no routine way to scan every person in the United States for people who look like your suspect.