3 ms·
Half of the problem with these tools is that software companies have oversold their competence to a wild degree, to the point where it is trusted as much as a D
by dundarious 3y ago
Half of the problem with these tools is that software companies have oversold their competence to a wild degree, to the point where it is trusted as much as a DNA test. "The AI said it's her". No further thinking is required, such as thinking about what photo the AI used, whether an 8-months pregnant woman really had sex with this guy before the stick up, etc. Trust the fancy computer.
But I also don't think it's too cynical to believe that at this point, almost everybody up and down the chain knows that these tools don't work very well, but what they like is that they are allowed to defer to these tools. It's like how nobody is fired for buying IBM -- nobody is at fault for relying on the algorithm.
This applies to many domains, even consumer tech stuff, hiring practices, etc. Algorithms are just a way to have a color by numbers process where employees have no agency and deserve very little pay, and management has no responsibility and cannot be blamed for mistakes.
- woodruffw 3y agoDNA testing is also significantly less reliable than the police would have you and I believe[1]. HN applies ample and eager skepticism to all kinds of scientific and science-adjacent fields; I eagerly await the day that we do the same for forensic "science." [1]: https://www.theatlantic.com/magazine/archive/2016/06/a-reasonable-doubt/480747/ https://www.theatlantic.com/magazine/archive/2016/06/a-reaso...
- dundarious 3y agoI haven't read your link yet, but fair point, I am aware there are definitely some issues with DNA testing as practiced by the justice system, but my prior was that when comparing facial recognition to DNA testing, using ideal conditions for both, DNA testing is on far surer footing than facial recognition -- and the ideal conditions for DNA testing are far more attainable than those for facial recognition. For example, I believe the people acquitted based on DNA testing are usually acquitted for good reason, and not just because it makes me feel good, but I'll read your article.