4 ms·
> HN users/voters seem habituated and predictable. What if this is applied to link titles to predict likelihood of making it to the front page? What words (or s
by minimaxir 8y ago
> HN users/voters seem habituated and predictable. What if this is applied to link titles to predict likelihood of making it to the front page? What words (or sequences of letters) are associated with popularity?
Apropos of nothing, I am working on building a model for predicting HN post performance.
TL;DR it is not easy.
- baccheion 8y agoI did one some years ago (basic attempt using XGBoost) and AUC was high 0.6s or low 0.7s. I think I treated the title as a string rather than words and each column/feature was one letter. That is, if there were 256 possible characters and each title could only be 80 characters long, there'd be 256 * 80 * 2 columns (title + title reversed).
- minimaxir 8y agoIf you are doing a classification model, what’s the score threshold? The trick with that approach is if you set the threshold high, it’s very easy to get a model with a high accuracy since classes will be imbalanced. (The vast, vast majority of HN submissions do not do well)
- baccheion 8y agoIf I remember correctly, HN's data dump included a made_front_page flag (not exact name). Also, XGBoost includes a feature that attempts to normalize against imbalanced classes. As for thresholds, there's only including submissions with at least average +/- standard_deviation votes.
- everdev 8y agoThis was built in '17: https://intoli.com/blog/hacker-news-title-tool/ https://intoli.com/blog/hacker-news-title-tool/ HN discussion: https://news.ycombinator.com/item?id=14400603 https://news.ycombinator.com/item?id=14400603