Hypothetically speaking: what if the algorithm had hardwired names and probabilities? {name:"Loomis", prob_recidivism:0.99} ? Then you're just throwing him int

Hypothetically speaking: what if the algorithm had hardwired names and probabilities? {name:"Loomis", prob_recidivism:0.99} ? Then you're just throwing him into jail because a lot of other Loomises turned out to be jerks. He must be allowed to verify the validity of the algorithm. The current situation is just 1 step above secret laws.