3 ms·
If the total population sampling is the same, I would expect the accuracies to remain the same. E.g. if I can get 72% accuracy in the total population just by l
by kevinventullo 6y ago
If the total population sampling is the same, I would expect the accuracies to remain the same. E.g. if I can get 72% accuracy in the total population just by looking at age/race/gender, doesn’t that exactly mean the accuracies in each individual category are on average 72%?
- mattnewton 6y agoNot necessarily because each age/race/gender tuple can be present in the test dataset different amounts, and either be a stronger or weaker indicator to the model.
- kevinventullo 6y agoStill, it’s some kind of weighted average, right? Like that 3.5% drop seems to say more about the test data used than the model performance per se.