4 ms·
The study looks at 33 patients total, and the cases and controls come from entirely different data sets, with data coming from different devices that recorded s
by carbocation 7y ago
The study looks at 33 patients total, and the cases and controls come from entirely different data sets, with data coming from different devices that recorded signal at different frequencies.
There is nothing to see here.
- RosanaAnaDana 7y agoYou realize the fact that the validation dataset is independent of the training dataset is a YUGE red flag right?
- carbocation 7y agoWhere do they say that the validation dataset is independent of the training dataset? The case dataset is independent of the control dataset.
- brilee 7y agoApologies - I didn't catch that the HF / healthy patients are from two different datasets. Agreed that this essentially invalidates the result. The missing experiment is to have a third dataset from yet another machine, with both positive/negative examples, and use it as the test dataset. Then transferability questions are at least somewhat addressed.
- carbocation 7y agoNo apologies needed, we're all in agreement on the broad strokes! Your proposal is good: I would be quite surprised if it generalized, but that is definitely the way to find out.