4 ms·
An interesting point touched on in the article is the extent to which feedback from a predictive algorithm contributes to its later predictions being biased. If
by ramblenode 10y ago
An interesting point touched on in the article is the extent to which feedback from a predictive algorithm contributes to its later predictions being biased. If police are targeting a specific neighborhood because it is flagged as being a high crime area, then there is likely to be a higher arrest rate for innocent people too, i.e. a higher false positive rate. Unless there is a good way of differentiating false and true positives (which seems unlikely in a justice system heavily focused on plea bargains), then a cycle of over-policing may ensue. A good predictive algorithm would need to account for this type of temporal autocorrelation.
- visarga 10y ago> If police are targeting a specific neighborhood because it is flagged as being a high crime area, then there is likely to be a higher arrest rate for innocent people Police officers could be employed to periodically monitor a sample of the AI outputs and rate them. Humans can still be in the loop, just not at the lowest level of the loop. I'd have much more confidence in an AI that passes the tests and is independently monitored by humans, than in individuals taking the same decisions. An AI would be much more balanced, informed by more examples and tested to check its biases. Humans can always invoke discretion to justify their choices.
- throwwit 10y agoI'd expect diffusion of responsibility or just plain laziness to happen with a human in the loop. (Side note: This thread is talking about 'broken window' policy.)
- dev1n 10y agoFor further reading on the topic of fairness in machine learning I would like to point to this [1]. [1]: https://jeremykun.com/2015/07/13/what-does-it-mean-for-an-algorithm-to-be-fair/ https://jeremykun.com/2015/07/13/what-does-it-mean-for-an-al...
- IncRnd 10y agoOne could legitimately say that learning of patterns is the process of bias creation.
- deleted 10y ago[deleted]
- rz2k 10y agoCould that be a personnel training problem? The data in such a case would be saying there is a high number of crime victims, even if that number is correlated with the number of people committing crimes. And unless there's a corpse, the reports generally come from victims, not surveillance of criminals committing acts. Officers making themselves visible on the street and checking to make sure people are safe and finding out from them where dangers might come from, is different than directly treating everyone on the street like they're potential criminals.