3 ms·
Tell HN: Hacker News dataset on BigQuery hasn't been updated since Nov 2022
As you might know, there is a hackernews dataset on bigquery [1]:
"This dataset contains all stories and comments from Hacker News from its launch in 2006 to present."
I was going to do some data explorations with this data, but when I sorted the records by timestamp, I noticed the latest items belong to 2022-11-16 and the dataset hasn't been updated since then [2].
[1]: https://console.cloud.google.com/marketplace/product/y-combinator/hacker-news https://console.cloud.google.com/marketplace/product/y-combi...
[2]: https://imgur.com/a/w8kg8CW https://imgur.com/a/w8kg8CW
- zX41ZdbW 3y agoYou can recreate this dataset by your own, it is fairly easy: https://github.com/ClickHouse/ClickHouse/issues/29693 https://github.com/ClickHouse/ClickHouse/issues/29693
- diggan 3y agoFrom my own experience, you can download about 8 items at a time before you hit the rate limits, so you can pull down the entire thing in some hours on a good connection.
- deleted 3y ago[deleted]
- dang 3y agoI emailed them a few days ago asking if they could update it, but it's a third party project that we have no involvement with so I'm not sure what else we can do.
- naveen99 3y agoBy the way, did you know the average comment on hacker news gets 2 upvotes ? I was humbled to find out that my average comment only gets 0.7 upvotes. (Atleast according to my calculations). Explains the perceived high signal to noise for sure. But, Maybe it would be lower if downvoting didn’t require 500 karma.