3 ms·
The 72% number is the result when not controlling for demographics. When controlling for demographics, the results ranged from 65% to 71% accuracy. https://ww
by bhk 6y ago
The 72% number is the result when not controlling for demographics. When controlling for demographics, the results ranged from 65% to 71% accuracy.
https://www.nature.com/articles/s41598-020-79310-1/figures/2 https://www.nature.com/articles/s41598-020-79310-1/figures/2
It makes we wonder what the accuracy would be if they controlled for demographics at a smaller granularity, like sub-ethnicities.
Furthermore, it appears that the Canadian dating site data set was 54% conservative, so an algorithm that always guessed conservative would be correct 54% of the time. From the article I can't tell what the balance was for the other data sets.
- itsdrewmiller 6y ago"The accuracy is expressed as AUC, or a fraction of correct guesses when distinguishing between all possible pairs of faces—one conservative and one liberal." - so no way to guess better than 50%.
- bhk 6y agoAlso: "Overall, the average out-of-sample accuracy was 68%..." (again, this does not control for demographics). I would not call it "prediction" when the "predictor" was trained on the data set you're testing it against. The out-of-sample number would be more fairly called prediction. It's unclear what the number would be for out-of-sample accuracy corrected for demographics, but we could extrapolate a guess of 64%.