By Goodhart's Law, there does not exist such a metric of success. All success metrics are arbitrary in this situation. Software is written by people. Racist so

By Goodhart's Law, there does not exist such a metric of success. All success metrics are arbitrary in this situation. Software is written by people. Racist software comes from racist beliefs. A belief that a neural network will learn objectivity is a belief in objectivity, and both are wrong. Race is not a red herring; even though race may be only a social construction with no objective science behind it, the fact that people believe in and act as if race were real is a problem. In particular it often violates the Civil Rights Acts.