4 ms·
I used the API! It only takes a few hours to download your own copy with the tool I used https://github.com/jasonthorsness/unlurker https://github.com/jasonthor
by jasonthorsness 1y ago
I used the API! It only takes a few hours to download your own copy with the tool I used https://github.com/jasonthorsness/unlurker https://github.com/jasonthorsness/unlurker
I had to CTRL-C and resume a few times when it stalled; it might be a bug in my tool
- xnx 1y agoIs there any advantage to making all these requests instead of using Clickhouse o BigQuery?
- jasonthorsness 1y agoProbably not :P. I made the client for another project, https://hn.unlurker.com https://hn.unlurker.com, and then just jumped straight to using it to download the whole thing instead of searching for an already available full data set.
- Havoc 1y agoMy mistake - apologies. Had misunderstood what you did