3 ms·

First, let me say that I really like the idea of this site. You already have the tools built to scrape HN every 5 min so why not expand on this idea. It would b

by achew22 16y ago

First, let me say that I really like the idea of this site. You already have the tools built to scrape HN every 5 min so why not expand on this idea. It would be very interesting to create something that scrapes HN and then provides the N most popular articles (by vote) for the day where N is defined in the URL. It would also be interesting to scrape the "New" section and then have a special section that has more stringent than the HN front page. A sort of "HN Plus" (forgive my reference to Hulu). Personally I like that HN trickles (sometimes torrentially) in through the day. I will admit that sometimes I feel overwhelmed by the content but it is always a good break from whatever I'm doing. Maybe that should be an "Ask PG" of my own but the idea has been rolling around in my head for some time to do something similar. I'm glad you're a lot less lazy than me and doing something about it. Is there any way you would be willing to put the source up on GitHub?

cperciva 16y ago
provides the N most popular articles (by vote) for the day where N is defined in the URL Aside from the "don't include links which were on a previous Daily Hacker News", this is exactly what I do. The top-10 list for YYYY-MM-DD is at http://www.daemonology.net/hn-daily/YYYY-MM-DD.html http://www.daemonology.net/hn-daily/YYYY-MM-DD.html s there any way you would be willing to put the source up on GitHub? I'd prefer not to do that, simply because it would encourage people to add extra load to the HN web server -- besides which, the code is extremely trivial and I'm sure anyone who wants to could replicate it easily. :-)
- almost 16y ago
  Maybe you could provide the data as a JSON feed? Then others can do their thing without hurting the HN servers. I imagine the bandwidth to serve them would be pretty small (or maybe I underestimate the hunger for HN JSON feeds :p) I'm sure you have better things to do with your time, but it would be cool and maybe would lead to some other cool stuff...

by achew22 16y ago

cperciva 16y ago

provides the N most popular articles (by vote) for the day where N is defined in the URL Aside from the "don't include links which were on a previous Daily Hacker News", this is exactly what I do. The top-10 list for YYYY-MM-DD is at http://www.daemonology.net/hn-daily/YYYY-MM-DD.html http://www.daemonology.net/hn-daily/YYYY-MM-DD.html s there any way you would be willing to put the source up on GitHub? I'd prefer not to do that, simply because it would encourage people to add extra load to the HN web server -- besides which, the code is extremely trivial and I'm sure anyone who wants to could replicate it easily. :-)

almost 16y ago
Maybe you could provide the data as a JSON feed? Then others can do their thing without hurting the HN servers. I imagine the bandwidth to serve them would be pretty small (or maybe I underestimate the hunger for HN JSON feeds :p) I'm sure you have better things to do with your time, but it would be cool and maybe would lead to some other cool stuff...