2 ms·
> Is it fair to reject a loan because of the ethnic background of the applicant? That seems unfair to me. I think you're drawing the wrong conclusion from this
by AnthonyMouse 10y ago
> Is it fair to reject a loan because of the ethnic background of the applicant? That seems unfair to me.
I think you're drawing the wrong conclusion from this. Unless we think that black people are inherently less credit worthy (i.e. are genetically inferior), then what's really happening is that race is acting as a proxy for some other things that aren't being considered. Maybe living in a neighborhood with drugs and gang violence, or lack of social ties to more affluent people who could be leaned on in tough times, etc.
So we have a bias, which we know is wrong, and we have two ways to fix it. One is the cheater's way out, which is to just take race directly into account. The other is to find the set of actually-causative factors that correlate with race which if you took them into account would make it so that nothing more would be gained by also taking race into account, and use those instead.
And given the choice between those two ways of solving the wrongful statistical bias, the second one is clearly preferred. Predicting via causative factors is fairer than predicting via correlative factors -- it's more accurate. You don't introduce a new bias against the black small business owner who doesn't live in a bad neighborhood and does have financially-advantageous social ties.
This is true of all predictions based on correlations, but there is a resource trade-off here. It may be more economical to collect data on things that correlate than things that cause. And causation is more predictive than correlation, but correlation is more predictive than nothing.
We can't pretend there aren't political considerations here. We're going to spend more resources to use causative factors instead of using race, for entirely political reasons, when we might not for some other factor. But the unfairness isn't to not use race (assuming we do actually find and use the underlying factors instead), it's only that we have to use more than the typical resources in order to get a more accurate result without using race. Which is a necessary evil given the politics.
But just leaving the known bias without finding and using the underlying factors to mitigate it is clearly wrong.
- yummyfajitas 10y agoI think you're drawing the wrong conclusion from this. Unless we think that black people are inherently less credit worthy (i.e. are genetically inferior), then what's really happening is that race is acting as a proxy for some other things that aren't being considered. "Inherent" is always with respect to a particular data set - if there is no data in the data set that is more predictive than a given factor, you might as well treat that as inherent when doing the data analysis - it won't change your algorithm at all. Maybe living in a neighborhood with drugs and gang violence, or lack of social ties to more affluent people who could be leaned on in tough times, etc. Could be. However, due to housing separation, this will also be correlated with race. Regulators consider using factors like this to be "redlining" and strongly frown on it. (Historically this was not true; in fact regulators drew the original red line.) The other is to find the set of actually-causative factors that correlate with race which if you took them into account would make it so that nothing more would be gained by also taking race into account, and use those instead. That certainly might be possible. If you can solve this, and those actually-causative factors do not redundantly encode race (e.g. no redlining), you have built the next unicorn startup. Your customers will be every single bank in America.
- AnthonyMouse 10y ago> "Inherent" is always with respect to a particular data set I meant it with respect to the hypothetical data set containing all possible data. Either there is a quite large disparity in the data which is actually caused by race and so can't be eliminated without considering it, or it's really mostly or entirely caused by some other factors that only correlate with race which we can hypothetically find and use instead. > Could be. However, due to housing separation, this will also be correlated with race. Regulators consider using factors like this to be "redlining" and strongly frown on it. (Historically this was not true; in fact regulators drew the original red line.) Traditional redlining was unconditionally denying loans for properties in black neighborhoods. Weighting neighborhoods based on their actual repayment history is something else entirely. > That certainly might be possible. If you can solve this, and those actually-causative factors do not redundantly encode race (e.g. no redlining), you have built the next unicorn startup. Your customers will be every single bank in America. Any factor that reduces racial bias is obviously going to correlate at least somewhat with race. It's mathematically necessary. But you can easily tell if a factor does more than redundantly encode race if considering race and that factor predicts more accurately than only considering race. Determining what the factors actually are would require having the data, which I don't have.