2 ms·
So, when your new software system identifies fraud where none was seen before the onus is really on you to check, recheck and triple-check your results before y
by jacquesm 3y ago
So, when your new software system identifies fraud where none was seen before the onus is really on you to check, recheck and triple-check your results before you start ruining people's lives. Those working on the present crop of AI classifiers should take note because those too can, will and probably already are being used to figure out who to target for surveillance, perform facial matching and will likely be embedded in AI based legal software. We're not that far from 'computer says guilty' and even if it isn't the computer that says so directly all it needs to do is give the wrong kind of person enough cover that they believe they are doing the right thing.
Something very similar happened in the Netherlands with the tax office and I suspect that if and when the IND here gets turned inside out we'll find a lot more of this sort of stuff.