4 ms·
I thought we were talking about machine algorithms, but it doesn't really matter. We're talking about a simple statistical mapping between two boolean propertie
by throwaway894345 6y ago
I thought we were talking about machine algorithms, but it doesn't really matter. We're talking about a simple statistical mapping between two boolean properties: skin tone and citizenship. You stipulated already that, for a given light-skinned person, the algorithm (machine or human) will return "non-citizen" with 99% confidence, and that that confidence interval is correct.
As far as I can tell, we can conclude from those facts that there is no bias (maybe I'm wrong, but I consider bias to be an errant belief); however, there are still potential issues:
* For what applications is 99% confidence acceptable? Can we do better by avoiding a statistical analysis altogether, e.g., by using citizenship records?
* Do we really believe/trust that humans are capable of 99% confidence (calling into question the fact that you established in your original post)?
* Are users of this algorithm rounding 99% up to 100%, thus disenfranchising one group 1% of the time (as opposed to distributing the error proportionately between the two groups)?