4 ms·
Looking for a "firehose" feed from Hacker News
I want to tap into a feed of all submissions to Hacker News. I poked around looking for this feed, but can't find it. Does it exist? Thanks in advance.
- vyrotek 16y agoA firehose doesn't exist. But, a few people have created API's which do the page scraping for you. I recommend http://api.ihackernews.com http://api.ihackernews.com
- ronnier 16y agoSoon I'll also be providing the entire hn database for download. I have the db, but I have bandwidth concerns. Anybody willing to work with me who has bandwidth to share?
- davewiner 16y agoWhy not distribute it via BitTorrent?
- davewiner 16y agoBTW, I'm happy to help with bandwidth, if I can. :-)
- ronnier 16y agoGreat! I'll email you when I get home. It's a 300 MB compressed XML file. 1 GB uncompressed. Contains comments, links, postedby, dates, parentid, and so on.
- ronnier 16y agoThat's probably what I'll end up doing. Id like to have it updated daily, seems like with BT there would be older copies floating around with newer copies unseeded.
- ronnier 16y agoUPDATE: I'm now seeding the file. You can find the torrent at http://api.ihackernews.com/ http://api.ihackernews.com/
- templaedhel 16y agoWhat size is it?
- ronnier 16y ago300 MB compressed.
- templaedhel 16y agoThats not to bad, it would be a quick torrent. I was just reading about the 640.6gb torrent of all the 2010 world cup games, in HD, 12gb per game, and the geocites torrent which was also quite big.
- spicyj 16y agoThere's http://news.ycombinator.com/newest http://news.ycombinator.com/newest and http://news.ycombinator.com/newcomments http://news.ycombinator.com/newcomments for new submissions and comments, respectively.
- davewiner 16y agoHere's the feed. http://static.scripting.com/hackernews/rss.xml http://static.scripting.com/hackernews/rss.xml Converted from the API, very easy to do. :-)
- BarkMore 16y agoI poked around and found this: http://hackernews.com/rss http://hackernews.com/rss