4 ms·
I think the article is not precise with their wording, but the 97% is actually recall (i.e. detects 97% of the positives).
by ericjang 9y ago
I think the article is not precise with their wording, but the 97% is actually recall (i.e. detects 97% of the positives).
- nonbel 9y agoCan you quote the part that leads you to think that? At first I was just commenting on the title, but see the edit. I would agree, my interpretation makes this the most ridiculous hype I have ever seen, so maybe I missed something.
- ericjang 9y agoNo quote in particular, but it seems unlikely that they would miss such a blatant dataset bias and fail to instrument their ML models with metrics besides accuracy. But then again, welcome to Silicon Valley :) 1 - 200/6158 = 97% is indeed a pretty suspicious coincidence though. I would assume/hope that they've shuffled a big dataset of recorded heart events (like the image in the TC article) and that the 200 people diagnosed with paroxysmal atrial fibrillation only rarely experience AF, so the number of true positives is probably far smaller than 1% of the dataset.
- nonbel 9y agoSee above, the value referred to AUC rather than accuracy.
- brandonb 9y ago(Cardiogram co-founder here) 97% refers to c-statistic (area under the ROC curve).