There are two different meta-uses of AI that we're talking about here. #1 AI as final step #2 AI as upstream step, with subsequent human review/adjustme

There are two different meta-uses of AI that we're talking about here. #1 AI as final step #2 AI as upstream step, with subsequent human review/adjustment In the case of medical AI, we're almost always talking about the latter: models preclassify or review results, which are then subsequently reviewed by a human. The cases people seem to have problems with are where no human eyes/hands provide oversight to probabilistically-correct model output*. It's an important enough distinction that I'd be in favor of mandating companies declare which they're using (for a specific use case). * As distinct from previous deterministically-correct expert systems / rules-engines