A danger of this view is that it can turn a descriptive view of the world into a normative view of the world. Suppose an AI does detect that men are more techn

A danger of this view is that it can turn a descriptive view of the world into a normative view of the world. Suppose an AI does detect that men are more technical, on average, than women. It would be a colossal mistake to then assume that our society should be a society where men are on average more technical than women based merely on the fact that historically that has been the case. Would this sort of AI have entrenched past social evils, such as slavery, if in the 1860s it classified people according to the data available at the time? The fact that an AI classifies things accurately given the statistical data at the time should not be confused with giving a normative claim that that is the desired state of affairs of the world.