4 ms·
Cool idea. Anyway, I created a Top Stories Directory 2 days ago too. It will record down every number one stories starting from 2 days ago. But, it lost trackin
by siong1987 18y ago
Cool idea. Anyway, I created a Top Stories Directory 2 days ago too. It will record down every number one stories starting from 2 days ago. But, it lost tracking some stories due to some bugs. But, I already fixed them all.
http://hn.siong1987.com http://hn.siong1987.com
- xtimesninety 18y agonice work too :)
- siong1987 18y agoHow long do your crawl the Ycombinator once? Do you actually crawl every page on YC?
- xtimesninety 18y agoI scrape only the front page once every ~4hrs (minimum) Nearlyfreespeech.net doesn't have cron yet, so I'm using onlinecronjobs.com. If you want to scrape it on demand just go to http://hnweekly.watdahel.com/index/scrape http://hnweekly.watdahel.com/index/scrape
- siong1987 18y agoBut, if you only scrape the frontpage, how can you know the points for all the past stories which are not on the frontpage anymore?
- xtimesninety 18y agoIt's not 100% accurate, but it's close. The reason I did the website is so I can catch up with the good stories that were submitted earlier during the week (I usually read during weekends).
- parenthesis 18y agoIt would be good if you provided links to the corresponding HN/comments pages as well as to the stories themselves.