2 ms·
> At 4 GB, I'd just as soon query this locally, but this looks like a fun exercise. This requires scraping all the Hacker News data manually, for which I have
by minimaxir 11y ago
> At 4 GB, I'd just as soon query this locally, but this looks like a fun exercise.
This requires scraping all the Hacker News data manually, for which I have a tool to do so (https://github.com/minimaxir/get-all-hacker-news-submissions-comments https://github.com/minimaxir/get-all-hacker-news-submissions...) which I mentioned in the post you linked, but it still requires a significant amount of time to get/process the data, hence why the BigQuery dataset has a significant advantage.