I think it comes down to this question: should people interacting with a model have the right to know how that model behaves in ways that are socially relevant?

I think it comes down to this question: should people interacting with a model have the right to know how that model behaves in ways that are socially relevant? In the parole example, should parolees have access to the knowledge that the model predicts different recidivism rates for different races and by how much? In the business world, the answer is reached by answering the question "How would our reputation change if the public had access to this information?" The end result is that AI ethicists are hired for optics and subsequently have no real capacity to publish this information. Is this similar to how we interact with food? Is the 1990 Nutrition Labeling and Education Act a good or bad analogy to use? How similar is this to a food company hiring a food inspector and then firing them when they discover that peanut might have contaminated some other products? I guess if people don't know they won't complain too much.