4 ms·
It is 2026. How are we still publishing articles on medical diagnostics data science and using area under the ROC curve as the primary metric of success. ROC-AU
by plaidfuji 14d ago
It is 2026. How are we still publishing articles on medical diagnostics data science and using area under the ROC curve as the primary metric of success. ROC-AUC of 0.9 under severe class imbalance (almost always the case in diagnostics) could still mean something like 4/5 predicted diagnoses are wrong (false positives). Precision-Recall curve + mAP or GTFO.
Science article in question:
https://www.science.org/doi/abs/10.1126/science.aec6129 https://www.science.org/doi/abs/10.1126/science.aec6129
Also, the most interesting result here is that the CNN-based feature encoder significantly outperformed a vision transformer encoder backbone…
- chrisjj 14d ago> How are we still publishing articles on medical diagnostics data science and using area under the ROC curve as the primary metric of success. Waste avoidance. Bullsh*t is more than sufficient to convince an AI-gulled target audience.
- steve-atx-7600 14d agoTeaching students how to interpret evidence must be way undervalued still. I went to one of the top CS schools 20 years ago and you could get a degree without even taking a single probability or stats class of any kind.