4 ms·
Yes, it is explicitly statistical bias, and it comes from extrapolating a system of equations from single point observable outcomes, a situation Economics tends
by tomrod 7y ago
Yes, it is explicitly statistical bias, and it comes from extrapolating a system of equations from single point observable outcomes, a situation Economics tends to solve with instrumental variables.
If I can, let me explain using basic quantity supplied and demanded.
Consider the supply equation: Q_s = a + bP + cX, and the demand equation, Q_d = e - fP + gZ. Data only observes where Q_s = Q_d given P, X, and Z.
So what most ML models attempt to do is predict Q as a single fit function of P, X, and Z -- not entirely unreasonable, but misses the structure of the full system. So two things to consider:
(1) Implementing a rule policy based on "measuring as it actually is" may result in a feedback cycle (personally I think there may be one in common real estate property valuation "AVM" models). By recruiters relying on a biased model the class imbalance may actually increase over doing nothing.
(2) Normative ideals, like being blind to anything but skill and opportunity or equalizing background (two common political ideals in the US) cannot be appropriately evaluated. This is Judea Pearl's claim of Pr(Y|X) versus Pr(Y|do(X)).
- MayeulC 7y agoI wonder if a Bayesian approach couldn't be taken to try to remain free of that bias, since it's basically designed for this (a system you can only observe part of).
- tomrod 7y agoWorth considering: https://www.tandfonline.com/doi/abs/10.1080/07474938.2013.807146 https://www.tandfonline.com/doi/abs/10.1080/07474938.2013.80...