5 ms·
> And many people don't. The difference is that I'm not asserting I have the one true definition, but rather recognizing that "bias" is a term with inherent pol
by AnthonyMouse 10y ago
> And many people don't. The difference is that I'm not asserting I have the one true definition, but rather recognizing that "bias" is a term with inherent political and moral content. And that pretending that this isn't (or shouldn't be) the case just because statisticians use the term in a technical setting is extraordinarily intellectually lazy.
Your assertion seems to be that not using the same word to describe separate and distinguishable things in a context where the distinction matters is intellectually lazy.
> If the goal is to accurately predict whether people will appear, then it's working.
> But if the goal is to accurately predict when people will choose not to show up, then there's certainly a chance that it's not working. For example, in the case where there's some significant correlation between race and access to transportation infrastructure. (Which isn't so much the case today, but certainly was 60 or so years ago.)
The goal is to predict whether people will appear. The bail-bondsman has to know whether to issue the bail-bond.
If your issue is transportation infrastructure then the only way to solve it is by fixing the transportation infrastructure, not by bankrupting the bail-bondsman.
> This is a separate discussion I don't want to have.
> But suffice it to say that conflating technical and non-technical definitions is not a reasonable defense of this position.
That's not the point -- the problem is that conflating technical and non-technical definitions is a way to avoid having that discussion.
Effectively everyone agrees that statistical bias is wrong. If you're on the wrong end of it you're being treated unfairly. If you can convince someone that something is this "bias" when everyone agrees bias is wrong then you've convinced them that the thing is wrong.
But if all you've done is broaden the scope of what bias means to encompass something that not everyone agrees is wrong then you've accomplished nothing of virtue. And more than likely misled some number of people who haven't managed to piece together that the "bias" they understand to be wrong and the "bias" you understand to be present are non-overlapping.
- yummyfajitas 10y agoEffectively everyone agrees that statistical bias is wrong. If you're on the wrong end of it you're being treated unfairly. That's not quite true. An unbiased credit scoring algorithm would penalize blacks, subtracting 50 pts or so from their FICO score. Is it fair to reject a loan because of the ethnic background of the applicant? That seems unfair to me. Then again forcing a lender to give out loans that he knows will default also seems unfair, to say nothing of the higher interest rates that Asians must pay in order to subsidize deadbeat blacks. I don't quite know what "fair" means here. What I do know is that the term "bias" is used to mislead; to hide the fact that whatever choice we make, there is a cost to be paid.
- AnthonyMouse 10y ago> Is it fair to reject a loan because of the ethnic background of the applicant? That seems unfair to me. I think you're drawing the wrong conclusion from this. Unless we think that black people are inherently less credit worthy (i.e. are genetically inferior), then what's really happening is that race is acting as a proxy for some other things that aren't being considered. Maybe living in a neighborhood with drugs and gang violence, or lack of social ties to more affluent people who could be leaned on in tough times, etc. So we have a bias, which we know is wrong, and we have two ways to fix it. One is the cheater's way out, which is to just take race directly into account. The other is to find the set of actually-causative factors that correlate with race which if you took them into account would make it so that nothing more would be gained by also taking race into account, and use those instead. And given the choice between those two ways of solving the wrongful statistical bias, the second one is clearly preferred. Predicting via causative factors is fairer than predicting via correlative factors -- it's more accurate. You don't introduce a new bias against the black small business owner who doesn't live in a bad neighborhood and does have financially-advantageous social ties. This is true of all predictions based on correlations, but there is a resource trade-off here. It may be more economical to collect data on things that correlate than things that cause. And causation is more predictive than correlation, but correlation is more predictive than nothing. We can't pretend there aren't political considerations here. We're going to spend more resources to use causative factors instead of using race, for entirely political reasons, when we might not for some other factor. But the unfairness isn't to not use race (assuming we do actually find and use the underlying factors instead), it's only that we have to use more than the typical resources in order to get a more accurate result without using race. Which is a necessary evil given the politics. But just leaving the known bias without finding and using the underlying factors to mitigate it is clearly wrong.
- yummyfajitas 10y agoI think you're drawing the wrong conclusion from this. Unless we think that black people are inherently less credit worthy (i.e. are genetically inferior), then what's really happening is that race is acting as a proxy for some other things that aren't being considered. "Inherent" is always with respect to a particular data set - if there is no data in the data set that is more predictive than a given factor, you might as well treat that as inherent when doing the data analysis - it won't change your algorithm at all. Maybe living in a neighborhood with drugs and gang violence, or lack of social ties to more affluent people who could be leaned on in tough times, etc. Could be. However, due to housing separation, this will also be correlated with race. Regulators consider using factors like this to be "redlining" and strongly frown on it. (Historically this was not true; in fact regulators drew the original red line.) The other is to find the set of actually-causative factors that correlate with race which if you took them into account would make it so that nothing more would be gained by also taking race into account, and use those instead. That certainly might be possible. If you can solve this, and those actually-causative factors do not redundantly encode race (e.g. no redlining), you have built the next unicorn startup. Your customers will be every single bank in America.
- throwaway729 10y ago> That's not the point -- the problem is that conflating technical and non-technical definitions is a way to avoid having that discussion. On this we can 100% agree. Choosing "bias" to mean "statistical bias", and then actively ignoring anything else that is currently called bias, is an extremely political choice. Are you seriously asserting that naming clashes validate political opinions, or that some large group of people's political opinions would suddenly change if only they knew the statistical meaning of bias?
- yummyfajitas 10y agoNo one said we should ignore this other concept. All I said is that we should name it something else. Are you seriously asserting that naming clashes validate political opinions, or that some large group of people's political opinions would suddenly change if only they knew the statistical meaning of bias? Yes, I think this use of "bias" is meant to mislead. Specifically, I think the term "bias" is used to make people think machines are drawing incorrect conclusions (that's what "bias" means in the dictionary and in most common uses of the term). There are two separate concepts: 1) An algorithm refuses to issue loans to blacks even though those blacks would pay the loans back. 2) An algorithm refuses to issue loans to blacks because they would not pay the loans back. You want to use the term "bias" to describe both situations; I think this will mislead people. Specifically most people will think "bias" means we live in situation (1). I want to use "bias" to refer to (1) and to use a separate term to refer to (2). Why do you want to conflate these two situations?
- smallnamespace 10y agoReplace the word 'algorithm' with 'person' or 'institution'. The politics around racial discrimination and bias means that in reality, few people do the work to tease apart (1) and (2). In particular, I think many people are extremely uncomfortable with the consequences that (2) being true entail. Hence 'racial bias' usually has a simpler meaning: something is biased if the decision conditioned on race is not identical to the unconditional decision. That encompasses both (1) and (2). You seem to ascribe some sort of malicious motive to the authors, when what you really have a problem with is how the country talks about race and racial bias in general. The point is that in general, statistically unbiased algorithms will not lead to racially unbiased (in the strict conditional outcome = unconditional outcome sense) results. You might think this is completely obvious as a practitioner in the field, but it is far from obvious to the general public. Hence why it's fair to point that out to the public.