The paper fails to discuss the fact that the data for a given patient is biased by the preliminary (likely unrecorded) diagnoses of the doctor. The doctors are

The paper fails to discuss the fact that the data for a given patient is biased by the preliminary (likely unrecorded) diagnoses of the doctor. The doctors are trained to systematically order certain sets of tests depending on their preliminary diagnoses. If some doctors have a pretty good idea of the final diagnosis, the deep learning classifier is simply learning what doctors do when they suspect a particular disease. It is not learning to predict a disease. A truer test of the deep learning method would also require that the deep learning algorithm orders the tests, or that we randomly select tests for a patient -- both of these possibilities are highly unethical.