3 ms·
Hi, Felipe Hoffa at Google here. We're aware the dataset hasn't been updated since a month ago, and we are working to fix it. You can track the issue here: -
by fhoffa 8y ago
Hi, Felipe Hoffa at Google here.
We're aware the dataset hasn't been updated since a month ago, and we are working to fix it. You can track the issue here:
- https://issuetracker.google.com/issues/127132286 https://issuetracker.google.com/issues/127132286
In the meantime you can still play with the dataset, and dig into the full history of Hacker News - less this last month. I left some interesting queries to get you started here:
- https://medium.com/@hoffa/hacker-news-on-bigquery-now-with-daily-updates-so-what-are-the-top-domains-963d3c68b2e2 https://medium.com/@hoffa/hacker-news-on-bigquery-now-with-d...
- espeed 8y agoWow, what timing. Late last night I had a conversation with someone explaining that Hacker News is not your typical message board -- it's owned and operated by YC and sits atop algorithms developed by some of the pioneers in spam and anomaly detection [1] [2], and it's is also an open dataset -- analyzed and scrutinized -- used by hackers worldwide to train and test bespoke AI. HN is a live MNIST [3] for anomaly detection. [1] http://www.paulgraham.com/spam.html http://www.paulgraham.com/spam.html [2] http://googlesystem.blogspot.com/2007/07/paul-buchheit-man-behind-gmail.html http://googlesystem.blogspot.com/2007/07/paul-buchheit-man-b... [3] http://yann.lecun.com/exdb/mnist/ http://yann.lecun.com/exdb/mnist/
- wodenokoto 8y agoHow do you run the import? Love to read more about how you consume the data
- physcab 8y agoI would also like to know where the data comes from!
- naveen99 8y agoAny particular reason you don’t include user profiles in the dataset ? I ended up pulling them myself using the api...