3 ms·
Is bigquery-public-data.hacker_news still been updated?
https://console.cloud.google.com/bigquery?p=bigquery-public-data&d=hacker_news&page=dataset
Last modified is 20 Sept 2022, 08:43:54 UTC+1 . Is this no longer been updated?
Context: This dataset contains all stories and comments from Hacker News from its launch in 2006. Each story contains a story id, the author that made the post, when it was written, and the number of points the story received.
- zX41ZdbW 3y agoIt's easy to download this data by yourself from HN API. Simple shell script and one day, and you have the full dataset: https://github.com/ClickHouse/ClickHouse/issues/29693 https://github.com/ClickHouse/ClickHouse/issues/29693
- PaulHoule 3y agoI wrote a script to download just the headlines that performs well. Since the objects are ordered sequentially it is straightforward to add new articles incrementally.