53 ms·
A few comments about on Hacker News data (i.e why I haven't played with the data in awhile): 1. The algorithm changed recently. This post uses >40pts as a prox
by minimaxir 10y ago
A few comments about on Hacker News data (i.e why I haven't played with the data in awhile):
1. The algorithm changed recently. This post uses >40pts as a proxy for front pageness. That's too conservative; even my 10pt threshold back then was conservative. With recent algorithm changes to Hacker News (<1 yr), I've seen posts with 3pts get into the Top 10 for whatever reason, which breaks predictive analysis.
2) The dataset/this submission only includes submissions/ submission scores; comment scores were removed from the API which is disappointing.
3) Given that HN titles/links can be edited by moderators (and they do a good job), it's harder to judge initial submissions from the final result.
4) Slight edge case in the article, but link shorteners are auto-killed which is why youtu.be/goo.gl links are not prominent.
- fhoffa 10y agoYou are the expert! (and I linked to one of your posts in the article too) Replying to the comments: 1) Yes, it doesn't take many votes to reach the front page, but once a post gets established there I expect it to gather more upvotes (then crossing the 40 points threshold). 85% of posts on the front page right now have >30 upvotes now, and I expect them to keep going up. 2) We don't have comment scores, but we do have them ranked. So you could assign them points based on what position they are relative to others, and what position does their parent have. Looking forwards to the experiment :). 3) Yup, titles matter a lot, and unfortunately we don't know what titles were modified after the fact. 4) Thanks for the clarification! Thinking about 2) - as you comment a lot and you can see your own comment scores, we could train a model that goes from rank/time to score.
- fhoffa 10y agoData points: So this post made it to the front page with few votes, but 2 hours later it dropped off with 31 votes. Lessons: - Maybe don't post on a Friday afternoon. - Maybe don't post from medium.com (low chances). - >40 score choice seems sound, to look at posts with front-page permanence.
- minimaxir 10y ago- Meta-submissions receive an extra penalty. Another reason why analysis is tricky, as such submissions are hard to algorithmically identify. If manual penalties were public, they could be accounted for in a model. That's another reason why I like Reddit data better; fewer unknown penalties.
- redrummr 10y ago> I've seen posts with 3pts get into the Top 10 for whatever reason I always thought it was to inject more freshness into the front page, and that certain 'authentic' users (no single-domain or all-the-things upvoters) had the power to lend more credibility to a new submission.