4 ms·
Hnweekly: weekly top stories from Hacker News
- xtimesninety 18y agoI've been looking for something like this but didn't find one. btw I only started scraping like 2 days ago :) so it's not yet a week's worth of data. fyi: there's also http://news.ycombinator.com/lists http://news.ycombinator.com/lists which shows the top stories in 2 weeks
- TweedHeads 18y agoLists are almost cool. Allow us to choose: Today, Yesterday, Week, Month, Year
- smanek 18y agoPretty useful. It would be nice to be able to see the top stories over any arbitrary time period as well. I imagine an interface with a draggable timeline to specify the period (something similar to what google finance uses, perhaps) could be even better.
- xtimesninety 18y agothanks, i'm planning to add that too. you can also try this (to see more recent links): http://hnweekly.watdahel.com/?days=1 http://hnweekly.watdahel.com/?days=1
- jasoncartwright 18y agoGood work. Needs an RSS feed.
- xtimesninety 18y agogood idea :)
- xtimesninety 18y agonow with rss feeds!
- ggruschow 18y agoIt looks like it sorts by points? Is that the best way to determine top stories, or would something like a time-at-position score be better? (Thanks - I kept meaning to do this myself. Would you do proggit & friends too, please?)
- xtimesninety 18y agoyep it's sorted by points. reddit already has this: http://www.reddit.com/r/programming/top/?t=week http://www.reddit.com/r/programming/top/?t=week not sure about the other sites, I'm just usually on hn, reddit and stuff on my google reader
- siong1987 18y agoCool idea. Anyway, I created a Top Stories Directory 2 days ago too. It will record down every number one stories starting from 2 days ago. But, it lost tracking some stories due to some bugs. But, I already fixed them all. http://hn.siong1987.com http://hn.siong1987.com
- xtimesninety 18y agonice work too :)
- siong1987 18y agoHow long do your crawl the Ycombinator once? Do you actually crawl every page on YC?
- xtimesninety 18y agoI scrape only the front page once every ~4hrs (minimum) Nearlyfreespeech.net doesn't have cron yet, so I'm using onlinecronjobs.com. If you want to scrape it on demand just go to http://hnweekly.watdahel.com/index/scrape http://hnweekly.watdahel.com/index/scrape
- siong1987 18y agoBut, if you only scrape the frontpage, how can you know the points for all the past stories which are not on the frontpage anymore?
- xtimesninety 18y agoIt's not 100% accurate, but it's close. The reason I did the website is so I can catch up with the good stories that were submitted earlier during the week (I usually read during weekends).
- parenthesis 18y agoIt would be good if you provided links to the corresponding HN/comments pages as well as to the stories themselves.
- TweedHeads 18y agoAllow it to sort by number of comments
- abossy 18y agoAgreed. It is often useful to see which stories are the most-discussed.
- xtimesninety 18y agoalright :) http://hnweekly.watdahel.com/?order=comments http://hnweekly.watdahel.com/?order=comments
- tome 18y agoDoesn't seem to handle non-ASCII very well: "Does Gdel matter?"
- xtimesninety 18y agoI might have problems with unicode in PHP (I really don't know much here yet) so I opted to remove them (for now) using regex. btw I'm using http://simplehtmldom.sourceforge.net/ http://simplehtmldom.sourceforge.net/ to scrape/parse which is great, it let's you use jquery style selectors on html.
- delano 18y agoIn that case, it should replace ö with o, etc.
- rtw 18y agoI have a screenscraping thing in place that targets an ASCII only environment (LambdaMOO mud). Manually replacing unicode stuff like this has been a pain in the butt. Luckily that was all just for fun and didn't need to be perfect. Is there a good library out there (in any language) that does good unicode --> ASCII substitutions for major languages?
- xtimesninety 18y agoI once used latin1_to_ascii (The Unicode Hammer) in python: (works great) http://code.activestate.com/recipes/251871/ http://code.activestate.com/recipes/251871/
- rtw 18y agoAwesome thanks. Two coincidences: this fun mud thing is in Python (works via RPC)... and the entry method name is "hammer," heh.
- russell 18y agoö doesn't need Unicode. It's ISO-Latin-1 (ISO-8859-1). An update is ISO-8859-15. Latin-1 is an 8 bit character set including ASCII, covering the Western European languages. I don't know PHP, but it could be the default or a simple character set option.
- rokhayakebe 18y agoNice and very useful.
- epi0Bauqu 18y agoFor a feed of all the #1 HN stories, use http://feeds.feedburner.com/HNWatrcoolr http://feeds.feedburner.com/HNWatrcoolr For more top stories from hacker feeds, use http://hacker.watrcoolr.us/ http://hacker.watrcoolr.us/ (feed: http://feeds.feedburner.com/HackerWatrCoolr http://feeds.feedburner.com/HackerWatrCoolr)