3 ms·
Ask HN: Any HN stats analysis been done?
I was just thinking of some questions about HN discussions - things like what does the average discussion look like? How long between replies is common / polite (I seem to let the other end hang for hours)
I don't particularly care about best time to post (that's defined by me as when I am struck by something) but there are many interesting questions one could ask the corpus
(Which leads to the other question - is there a good way to get hold of the corpus?)
- jcr 11y agoThere's the main HackerNews API [1] via firebase.com, and there's also the Algolia HN Search API [2]. Over the years I've seen quite a few collections of data [3, 4, 5, 6], but how complete they are and whether or not they've been maintained is unknown. [1] https://github.com/HackerNews/API https://github.com/HackerNews/API [2] https://github.com/algolia/hn-search https://github.com/algolia/hn-search [3] https://archive.org/details/HackerNewsStoriesAndCommentsDump https://archive.org/details/HackerNewsStoriesAndCommentsDump [4] https://ia902503.us.archive.org/33/items/HackerNewsStoriesAndCommentsDump/ https://ia902503.us.archive.org/33/items/HackerNewsStoriesAn... [5] http://shitalshah.com/p/downloading-all-of-hacker-news-posts-and-comments/ http://shitalshah.com/p/downloading-all-of-hacker-news-posts... [6] https://news.ycombinator.com/item?id=7835605 https://news.ycombinator.com/item?id=7835605
- danso 11y agoThere was this last week: a dump of the 10M comments and posts so far: https://news.ycombinator.com/item?id=10002791 https://news.ycombinator.com/item?id=10002791
- Aeolus98 11y agoI particularly like Andrej Karpathy's analysis: https://cs.stanford.edu/people/karpathy/hn_analysis.html https://cs.stanford.edu/people/karpathy/hn_analysis.html
- gwern 11y agoHere's a list of relevant links I've compiled over the past year or two: - http://nathanael.hevenet.com/the-best-time-to-post-on-hacker-news-a-comprehensive-answer/ http://nathanael.hevenet.com/the-best-time-to-post-on-hacker... - http://minimaxir.com/2014/02/hacking-hacker-news/ http://minimaxir.com/2014/02/hacking-hacker-news/ - http://minimaxir.com/2014/10/hn-comments-about-comments/ http://minimaxir.com/2014/10/hn-comments-about-comments/ - http://karpathy.ca/myblog/2013/11/27/quantifying-hacker-news-with-50-days-of-data/ http://karpathy.ca/myblog/2013/11/27/quantifying-hacker-news... https://cs.stanford.edu/people/karpathy/hn_analysis.html https://cs.stanford.edu/people/karpathy/hn_analysis.html - http://metamarkets.com/2011/hacking-hacker-news-headlines/ http://metamarkets.com/2011/hacking-hacker-news-headlines/ - http://danluu.com/randomize-hn/ http://danluu.com/randomize-hn/ - http://www.bayesianwitch.com/blog/2013/why_hn_shouldnt_use_randomized_algorithms.html http://www.bayesianwitch.com/blog/2013/why_hn_shouldnt_use_r... - http://camdp.com/blogs/multi-armed-bandits http://camdp.com/blogs/multi-armed-bandits - http://gkosev.blogspot.com/2012/08/fixing-hacker-news-mathematical-approach.html http://gkosev.blogspot.com/2012/08/fixing-hacker-news-mathem... - http://blog.rjmetrics.com/2012/10/17/surprising-hacker-news-data-analysis/ http://blog.rjmetrics.com/2012/10/17/surprising-hacker-news-... - http://blog.rjmetrics.com/2012/10/24/how-to-get-on-the-front-page-of-hacker-news/ http://blog.rjmetrics.com/2012/10/24/how-to-get-on-the-front... - http://blog.datadive.net/which-topics-get-the-upvote-on-hacker-news/ http://blog.datadive.net/which-topics-get-the-upvote-on-hack... - https://news.ycombinator.com/item?id=8790134 https://news.ycombinator.com/item?id=8790134 - https://porter.io/blog/hackernews-cheaters-catch-me-if-you-can/ https://porter.io/blog/hackernews-cheaters-catch-me-if-you-c... https://news.ycombinator.com/item?id=9332889 https://news.ycombinator.com/item?id=9332889 - http://www.righto.com/2013/11/how-hacker-news-ranking-really-works.html http://www.righto.com/2013/11/how-hacker-news-ranking-really... - https://news.ycombinator.com/item?id=9336759 https://news.ycombinator.com/item?id=9336759 https://news.ycombinator.com/item?id=9333611 https://news.ycombinator.com/item?id=9333611 - http://www.almostinfinite.com/other/hacker-news-new-page-scroll-of-death.html http://www.almostinfinite.com/other/hacker-news-new-page-scr...?
- minimaxir 11y agoI have a repository of scripts for downloading all Hacker News data using Python and storing in PostgreSQL: https://github.com/minimaxir/get-all-hacker-news-submissions-comments https://github.com/minimaxir/get-all-hacker-news-submissions...