How do we know that the algorithm is at all appropriate? How do we even know it's an algorithm at all and not a mechanical turk? The algorithm could be to hand

How do we know that the algorithm is at all appropriate? How do we even know it's an algorithm at all and not a mechanical turk? The algorithm could be to hand off the case files to some minimum wage college student and have them come up with some nice charts and graphs. After Theranos, this isn't even a hypothetical. It is clearly an injustice to use a secret algorithm regardless of outcome. But once again, corporate profit must come before justice, it seems.