3 ms·
In the event anyone wants to suggest analyses to perform, I'm game. For now, I'm parsing out title, points, comments, submitter, and the submission site. I'm
by dredmorbius 3y ago
In the event anyone wants to suggest analyses to perform, I'm game.
For now, I'm parsing out title, points, comments, submitter, and the submission site.
I'm classifying by state and city (list of 330 largest cities in the US by population), as well as a few "false positive" categories (e.g., "Washington Post", "New York Times").
One interesting angle I'm looking at is the average votes and comments by site within the data --- I'd been curious for a while as to which domains seem to be most highly considered (or at least successful in garnering votes and comments). I'm still waiting for the full archive to get pulled in, but early results are ... interesting. I'll leave it there. (Paulgraham.com rather predictably does well, though it's not the highest-rated.)
I'm also thinking of ways to do trending over time. In early data (I'm up to late 2011 / early 2012 as I'm writing this), sites including Quora and even jwz.com appear and ... do well. plus.google.com hasn't yet appeared, and a few others that come to mind don't seem represented yet. Top sites by year or over a five-year interval seems potentially illuminating.
Oh, and as far as states go, when restricted to front-page submissions only, California does far better than the Algolia search results (all non-dead/killed submissions) indicate.