8 ms·
Show HN: Quality News – Towards a fairer ranking algorithm for Hacker News
Hello HN!
TLDR;
- Quality News is a Hacker News client that provides additional data and insights on submissions, notably, the upvoteRate metric.
- We propose that this metric could be used to improve the Hacker News ranking score.
- In-depth explanation: https://github.com/social-protocols/news#readme https://github.com/social-protocols/news#readme
The Hacker News ranking score is directly proportional to upvotes, which is a problem because it creates a feedback loop: higher rank leads to more upvotes leads to higher rank, and so on...
→
↗ ↘
Higher Rank More Upvotes
↖ ↙
←
As a consequence, success on HN depends almost entirely on getting enough upvotes in the first hour or so to make the front page and get caught in this feedback loop. And getting these early upvotes is largely a matter of timing, luck, and moderator decisions. And so the best stories don't always make the front page, and the stories on the front page are not always the best.
Our proposed solution is to use upvoteRate instead of upvotes in the ranking formula. upvoteRate is an estimate of how much more or less likely users are to upvote a story compared to the average story, taking account how much attention the story as received, based on a history of the ranks and times at which it has been shown. You can read about how we calculate this metric in more detail here: https://github.com/social-protocols/news#readme https://github.com/social-protocols/news#readme
About 1.5 years ago, we published an article with this basic idea of counteracting the rank-upvotes feedback loop by using attention as negative feedback. We received very valuable input from the HN community (https://news.ycombinator.com/item?id=28391659 https://news.ycombinator.com/item?id=28391659). Quality News has been created based largely on this feedback.
Currently, Quality News shows the upvoteRate metric for live Hacker News data, as well as charts of the rank and upvote history of each story. We have not yet implemented an alternative ranking algorithm, because we don't have access to data on flags and moderator actions, which are a major component of the HN ranking score.
We'd love to see the Hacker News team experiment with the new formula, perhaps on an alternative front page. This will allow the community to evaluate whether the new ranking formula is an improvement over the current one.
We look forward discussing our approach with you!
Links:
Site: https://news.social-protocols.org/ https://news.social-protocols.org/
Readme: https://github.com/social-protocols/news#readme https://github.com/social-protocols/news#readme
Previous Blog Post: https://felx.me/2021/08/29/improving-the-hacker-news-ranking-algorithm.html https://felx.me/2021/08/29/improving-the-hacker-news-ranking...
Previous Discussion: https://news.ycombinator.com/item?id=28391659 https://news.ycombinator.com/item?id=28391659
- mhb 4y agoWould just increasing the number of posts on the front page be an improvement?
- manx 4y agoI think so. The first page gets much more upvotes than the second page. There is a visible step in the data: https://github.com/social-protocols/news#upvote-share-by-rank https://github.com/social-protocols/news#upvote-share-by-ran... Once a story drops to the second page, it receives fewer upvotes and can't sustain any growth anymore. Having a longer front page (we're showing 90 ranks), smooths out that effect.
- taubek 4y agoCan I somehow see the historical data for some of mine old submits? I seems to me that on https://news.social-protocols.org/ https://news.social-protocols.org/ I can get the data for past 24 hours. I think that you have point with feedback loop.
- manx 4y agoWe just reset the history yesterday and plan to keep data for about one month for now. In the future, it should definitely be possible to retain a much longer time span.
- taubek 4y agoI like the visualization part of upvotes coming in. I always wondered when do votes actually get in. I've seen a graph approach to finding the most influential users at https://memgraph.com/blog/how-i-found-the-most-influential-users-on-hacker-news https://memgraph.com/blog/how-i-found-the-most-influential-u.... Maybe there is something that you could incorporate into your app.
- taubek 4y agoI just tested this with one of my news submits. I really find this to be very useful.