2 ms·
You can now get Hacker News data in real time from the Hacker News API powered by Firebase: https://github.com/HackerNews/API https://github.com/HackerNews/API
by xnx 3y ago
You can now get Hacker News data in real time from the Hacker News API powered by Firebase: https://github.com/HackerNews/API https://github.com/HackerNews/API
This is great (real time!), but also kind of a pain (38+ millions individual http requests to get the whole thing).
Thankfully there's no authentication or apparent rate limiting. I fumbled my way through downloading the whole thing with curl. I screwed up a few times so made over 70 million requests in total.
Toy analysis of the data I downloaded here: https://public.tableau.com/app/profile/isna/viz/HackerNewsDashboard_17042353296150/HackerNewsYearinReview2023 https://public.tableau.com/app/profile/isna/viz/HackerNewsDa...