The issue is not whether justice can be codified. Let us assume that you can and it's outlined on page 3 of your document. Providing examples to an ML model don

The issue is not whether justice can be codified. Let us assume that you can and it's outlined on page 3 of your document. Providing examples to an ML model don't guarantee it will codify anything similar to that. This is a fundamental issue. Most machine learning models aren't highly interpretable and can also act in unexpected ways. Re: (a) variables with a low correlation to race / (b) dishonest about how much ML systems can "infer hidden variables": (b) The example you point to is specifically adversarial modification to the input data. I'm not sure how that's relevant to your point at hand except to say that ML models can be misguided when given slightly modified input. It doesn't show that inferring hidden variables is anecdotal. If you look at the work of machine translation with attention, it explicitly learns how to do alignments even though it is never given training data for it. We can visualize that[1]. (a) There is interesting work on trying to produce variables with a low correlation to race. One recent example[2] has two networks use the same intermediate representation created from the raw input. One of the networks tries to identify a particular variable (race / gender / ...) while the other tries to perform the overall objective task. We aim to modify the way we generate the intermediate representation such that the former network has a harder time identifying the sub groups whilst allowing the latter group to continue to improve on the original task. This is recent however. There are many other interesting explorations. Regarding when to use features that may leak information, this is referred to as the fairness / utility tradeoff. If you want to see an example of both that and trying to prevent information leakage about gender in a dataset on adult income, refer to "Certifying and removing disparate impact"[3]. Note: the models used by the statistician in the article do not appear to feature anywhere near this level of analysis. Ensuring to avoid features that result in strong bias or prejudice against specific groups in a dataset is still an open problem. [1]: https://devblogs.nvidia.com/parallelforall/wp-content/uploads/2015/07/Figure6_sample_translations1-624x282.png https://devblogs.nvidia.com/parallelforall/wp-content/upload... (image from https://devblogs.nvidia.com/parallelforall/introduction-neural-machine-translation-gpus-part-3/ https://devblogs.nvidia.com/parallelforall/introduction-neur...) [2]: http://arxiv.org/abs/1511.05897 http://arxiv.org/abs/1511.05897 [3]: http://arxiv.org/abs/1412.3756 http://arxiv.org/abs/1412.3756