62 ms·
Well, I like to think I have lots of million dollar ideas ;) However, in this case, a retrospective algorithm doesn't have to compete in the same category as t
by danso 11y ago
Well, I like to think I have lots of million dollar ideas ;)
However, in this case, a retrospective algorithm doesn't have to compete in the same category as the one that ranks and applies gravity to the submissions. Ignoring the effect of flags and manual moderation, the ranking algorithm has to work in near real time -- and it seems to, as occasionally a single upvote will send a submission straight up the front page depending on its current gravity -- while not causing the server to shit the bed.
A retrospective algorithm doesn't have to be that efficient, and can drastically reduce computation by filtering for past submissions that have received a cutoff of top votes. Running various aggregations/analysis on discussion can likewise be done in relative peace. Furthermore, you have the ability to provide external heuristics...for example, filtering for submissions that were first submitted to HN before getting strong notice on Twitter or Reddit (which can be done by comparing URL submissions and timestamps).
This is not to say that coming up with the "best" or even "better" is trivial. It's just that the computational factors are significantly different between the algorithm that has to do real-time ranking and one that performs a historical analysis.
That said, it'd be an interesting challenge to create a relatively simple bot that auto-submitted popular links in the same way that the popular Facebook "On this day" plugin works...the heuristic could be very simple: submit only URLs that haven't made the front page within the last 1.5 years and garnered 200+ upvotes...and then some filtering to avoid submitting obituaries or other current-event type posts. If the HN mods give approval to run a spam bot, I'll give it a try :)