3 ms·

I couldn't find any confirmation that they tested on out of sample ASD populations.

• hervature 3y ago
  From TFA: "" The data sets were randomly divided into training (85%) and test (15%) sets. We used 10-fold cross-validation to obtain generalized results of model performance. Data splitting was performed at the participant level and stratified based on the outcome variables. Because the data classes were imbalanced for symptom severity (ADOS-2 and SRS-2), we performed a random undersampling of the data at the participant level before conducting data splitting. """ 100% indicates a major case of data leakage. Particularly, "When we generated the ASD screening models, we cropped 10% of the image top and bottom before resizing because most images from participants with TD had noninformative artifacts (eg, panels for age, sex, and examination date) in 10% of the top and bottom." tells me that there are known issues with the photos. Quite possible the photos of the groups were taken on distinct days and/or times and the lighting conditions is enough to distinguish the groups. Possibly, the background for the ASD candidates have a different background or a different camera sensor.