I don't entirely disagree, but I urge caution. When we're designing an algorithm, there are things we care about. We try to capture these intuitions with impr

I don't entirely disagree, but I urge caution. When we're designing an algorithm, there are things we care about. We try to capture these intuitions with imprecise labels like "fair". Trying then to capture these labels in "precise mathematical knowledge" still leaves room for the mathematical formulation to disagree with the intuition as well as the intuition to itself be faulty in terms of tending to lead to the outcomes we want. In either case we could easily wind up unambiguously and effectively optimizing for the wrong thing.