4 ms·
> Therefore I first split the data into training and testing sets at a ratio of 9:1, and selected the 25 most correlated features in the training set. Each of t
by starchild_3001 7y ago
> Therefore I first split the data into training and testing sets at a ratio of 9:1, and selected the 25 most correlated features in the training set. Each of these features had a correlation with age between 0.83 and 0.94.
> The data was then split into training and testing sets at a ratio of 9:1, and fed into a sequential neural network.
What?? I thought it was split already.
(How training and test sets were obtained sounds fairly confusing. Did the author make sure there's no "data snooping" ?)
- ruborcalor 7y agoI apologize for the confusion, i've since removed this typo. The data is only split once, before using a correlation test to select the features that the model would be trained on. As far as I can tell there is no data snooping occurring because the data is split into train and test sets before any decision are made.