What is the predictive model predicting, and why would a recruiting agency use those attributes? Any model using nonsense data in predictive model can imminentl

What is the predictive model predicting, and why would a recruiting agency use those attributes? Any model using nonsense data in predictive model can imminently be ruled out, and I can make a trivial example like. * Most programmers have 10 toes. Fact. * A predictive model correctly identifies that more programmers have 10 toes than 9 toes. * A recruiting agency uses the predictive model and exclude programmers with 9 toes, but why? What possible use could they have with that model? The problem of recruiting agency that using biased predictive models is when the data is relevant for the recruitment purpose but create socially unacceptable conclusions such as: * There are more computer programmers that leave after the first year who identify themselves as women than men. (descriptive statement) * A predictive model use gender as data point to predict employee retention. * An internal recruiting agency within a company has goals of hiring employee with high retention in order to reduce training costs and uses the predictive model. This result in excluding women. The attribute being measured in the later case is relevant for the purpose of the recruiting, but it amplify gender segregation. When discussing AI recruiting bias it is this kind of problem we should focus on rather than looking at attributes which has no bearing on the purpose of recruiting. Attributes which has nothing to do with the goals of recruiting should not exist in a model for recruiting.