4 ms·
Instead of sending thousands of requests through that API you can download the full official dump on Google BigQuery Datasets.
by bigdict 5y ago
Instead of sending thousands of requests through that API you can download the full official dump on Google BigQuery Datasets.
- niros_valtos 5y agoAuthor of the post here (Nir, CEO of Arnica). Thanks for the feedback! That's a great tip, I wish I knew before. I'm not a developer (our developers are busy building the actual product) so I learn new things every day. I'll give the BigQuery dataset a try. EDIT: I took a look and it seems like that the last modification was on 2016.
- neogodless 5y ago> I'm not a developer ... so I learn new things every day Hopefully, that's true for developers, too!
- bigdict 5y agoNo there's a different one, you need "full" under hacker_news. It's updated at least daily.
- bigdict 5y agoRefer to this comment: https://news.ycombinator.com/item?id=29017712 https://news.ycombinator.com/item?id=29017712.
- mountaineer 5y agoI don't believe that BigQuery dataset is actively updated?
- bigdict 5y agoIt is, it's just hard to find and it's not the first thing you get when you search.
- bigdict 5y agoI'll look it up when I'm at the keyboard again and I'll message you.
- bigdict 5y agoFor posterity, here's a link to the dataset that is up-to-date. https://console.cloud.google.com/bigquery?p=bigquery-public-data&d=hacker_news&page=table&t=full https://console.cloud.google.com/bigquery?p=bigquery-public-... For details on how to get it out, read this comment tree: https://news.ycombinator.com/item?id=25075318 https://news.ycombinator.com/item?id=25075318