3 ms·
If you are doing a classification model, what’s the score threshold? The trick with that approach is if you set the threshold high, it’s very easy to get a mod
by minimaxir 8y ago
If you are doing a classification model, what’s the score threshold?
The trick with that approach is if you set the threshold high, it’s very easy to get a model with a high accuracy since classes will be imbalanced. (The vast, vast majority of HN submissions do not do well)
- baccheion 8y agoIf I remember correctly, HN's data dump included a made_front_page flag (not exact name). Also, XGBoost includes a feature that attempts to normalize against imbalanced classes. As for thresholds, there's only including submissions with at least average +/- standard_deviation votes.