3 ms·

I don't see how it will be different this time. The past decade has seen a bunch of failed projects that used algorithms to do the heavy lifting, and justice an

I don't see how it will be different this time. The past decade has seen a bunch of failed projects that used algorithms to do the heavy lifting, and justice and redress for those involved has not even been served in all cases. The Dutch Toeslagenaffaire¹ was a massive failure of using discriminating algorithms to judge if tax payers were defrauding the state (most of those marked as fraudsters were innocent and many lost jobs, housing, and hundreds even had their children placed into foster care (!) due to the cascading effects caused by being on this list). The British Post Office scandal² is another famous case that will be familiar to those from the UK. 1: https://news.ycombinator.com/item?id=31013994 https://news.ycombinator.com/item?id=31013994 2: https://en.wikipedia.org/wiki/British_Post_Office_scandal https://en.wikipedia.org/wiki/British_Post_Office_scandal

belter 4y ago
To call Dutch Toeslagenaffaire a failure of discriminating algorithms, when the main criteria was: Manually identify innocents based if they were born outside the Netherlands or married to somebody born outside the Netherlands, or if they were born in the Netherlands, had Dutch nationality but grand parents born outside the Netherlands....Is a very strange characterization.
- Freak_NL 4y ago
  I think you may have misread my comment. The algorithms didn't fail; they did exactly what they were programmed to do. The failure lay in the use of these algorithms; i.e., such algorithms should never have been developed and subsequently used to put people on a blacklist.
  - tluyben2 4y ago
    Anything automated that has the potential to ruin people’s lives should first be checked by humans when flagged. That’s why this csam thing, if used, will cause crazy amounts of human work, and/or, after first ‘convicting’ a bunch of people and a lot of bad press, will then be toned down to only go after already suspected individuals but now their data can be scanned without a warrant.

belter 4y ago

To call Dutch Toeslagenaffaire a failure of discriminating algorithms, when the main criteria was: Manually identify innocents based if they were born outside the Netherlands or married to somebody born outside the Netherlands, or if they were born in the Netherlands, had Dutch nationality but grand parents born outside the Netherlands....Is a very strange characterization.

Freak_NL 4y ago
I think you may have misread my comment. The algorithms didn't fail; they did exactly what they were programmed to do. The failure lay in the use of these algorithms; i.e., such algorithms should never have been developed and subsequently used to put people on a blacklist.
- tluyben2 4y ago
  Anything automated that has the potential to ruin people’s lives should first be checked by humans when flagged. That’s why this csam thing, if used, will cause crazy amounts of human work, and/or, after first ‘convicting’ a bunch of people and a lot of bad press, will then be toned down to only go after already suspected individuals but now their data can be scanned without a warrant.