6 ms·
Reddit Insight
- oliverhunt 13y ago> r/Technology leads all SubReddits, with an average of 2,027 Karma per Post Is this saying that all posts in r/technology get an average of 2027 karma?
- malcolmmcc 13y agoMy prior on that is extremely low, so my guess is that's like, of the posts that make front-page? Or of the top posts. What this really reflects, therefore, is something more like how up-votey people are.
- gdi2290 13y agoOur data was largely from posts that were above 0 Karma which I think is reflected in the analysis that we did.
- joshu 13y agoaverage is probably the wrong characterization of the distribution of karma per post.
- zoba 13y agoYou should know this site isn't usable/viewable on iPhone Safari or Chrome.
- gdi2290 13y agosorry about that it's our initial prototype
- gdi2290 13y agoSide note: everyone in our team is available for hire
- malcolmmcc 13y ago> "Dogs" occurs more times in titles in r/aww than "cats" or "kittens" That can be a fact. > Despite their internet popularity cats are not submitted nearly as many times on this cuddly SubReddit. Or dogs are rare enough that they're worth naming, because cats are default. Seriously, run whatever calculations you want, but be careful about what conclusions you draw from the numbers.
- gdi2290 13y agoGood point. We like to stir the pot a bit though.
- jader201 13y agoSo you're knowingly misrepresenting the data?
- mahmud 13y agoNobody skews cat data on the internet and gets away with it.
- dktbs 13y agoWhat do you mean by "stir the pot"? The purpose of this site seems to be data-driven analysis of reddit. If the conclusions being drawn aren't rooted in that data, I don't see the point.
- dmentat 13y agoBy purposefully lying?
- AjithAntony 13y agoYeah, there are probably more cat pictures just in the "If I fits, I sits" category, than dogs altogether
- ChuckMcM 13y agoSo two big design issues, if you scroll down from the wheel of terms you go wobbly, clicking the down arrow below that last wheel, also wobbly. If you use on of the tabs to go to a graph you create a 'back loop' where the back button takes you to the start, then back again takes you back to the graph, then back to the start then back to the graph .... The data is interesting but I expect to see a bit of analysis in projects like this. Without it the project becomes a sort of data Rorschach test where the viewer projects their perceptions into it.
- gdi2290 13y agoWe are aware of a lot of the issues on the home page and plan to completely redesign it soon. However which graph are you talking about? If it's the post tracking we will definitely look into it.
- ChuckMcM 13y agoI had clicked on the rightmost tab (labeled Graphs) and shows the Subredit graph and then got stuck in the back page loop. Although I just did it again and it didn't get stuck in a loop so you may have fixed that one already.
- gdi2290 13y agoThanks for your feedback. At the moment I'm not able to reproduce your issue, but I'll add it to our github issues
- ChiperSoft 13y agoI can't even read this on my iPhone. All of the text is forced into a tiny column so small that it wraps after nearly ever word. A lot of the text is pushed right off the right edge of the page. Please don't alter the viewport, you're doing it totally wrong.
- gdi2290 13y agoWe updated the landing page for better mobile support. Although we can't say the same for some of our d3 visualizations
- shaohua 13y agowe should do one for hacker news too.
- minimaxir 13y agoIt's much harder to get data from Hacker News, as HN doesn't have a public API (and HNSearch's API limits make it infeasable)
- jaredsohn 13y ago>(and HNSearch's API limits make it infeasable) I searched around and couldn't find information on API limits. Are these documented or just found via experiencing them? The Hacker News karma tracker posted this past January seems to be able to get the information that would be necessary for writing something like this.
- minimaxir 13y agoHNSearch has a limitation of 1000 maximum results returned (see [1]). You can take a snapshot of the Front Page / New Posts every so often a la [2], but it's limited per the robots.txt. It's possible, but more time intensive (as in the linked post) [1]: http://api.thriftdb.com/api.hnsearch.com/items/_search?q=medium.com&limit=100&filter[fields][domain]=medium.com&start=1000 http://api.thriftdb.com/api.hnsearch.com/items/_search?q=med... [2]: http://mayank.lahiri.me/writing/hackernews/index.html http://mayank.lahiri.me/writing/hackernews/index.html
- jaredsohn 13y agoThanks for the information (including the links.) Based on other comments on this post, it looks like HNSearch and Reddit APIs have the same limitations, so doing something like this should be feasible for Hacker News. Also, another post indicates that the data for Reddit was done with only single 1000-limit queries, so the time-intensive method shouldn't be needed to produce equivalent results (although it could provide more accurate results.) Finally, for those looking for something like this for Hacker News right now, check out these sites: http://www.hntrends.com/ http://www.hntrends.com/, http://hntrends.jerodsanto.net/ http://hntrends.jerodsanto.net/, Hacker News hiring trends (https://github.com/adamw523/hackernewshires https://github.com/adamw523/hackernewshires)
- dbpokorny 13y agoPlug for hackreactor.com. I worked with Cameron and Marcus at slide.com. Great people.
- alexleavitt 13y agoHow much of "the Reddit" did you actually use to calculate these stats? Is this based off a one-time snapshot from the API (which limits to 1000 posts, per type of query) or is it a longitudinal crawl (and how data was produced in that sample)?
- gdi2290 13y agoOne-time snap shot. Given longer time on this project we would love to do a larger analysis.
- Tomdarkness 13y agoSite was borderline unusable with Chrome on android. Text was overlapping, animations to display new text were being triggered after I scrolled past them and in some cases the text just flew in one side and right off the other side of the screen before I even got a glimpse of it.
- gdi2290 13y agoWe updated the landing page to better reflect your suggestions.
- joeblau 13y agoThis looks awesome. Next step is to make it "real-time." I worked for an analytics company and got to build some pretty awesome visualizations using D3 and one of the problems I always ran into was that while the visualizations are cool, you rarely get any actionable information from the charts. I feel like this would be a lot better if at the end, there was some call to action.
- minimaxir 13y agoReal time analytics is tricky due to API limits. (unless you can accept a "real time" of minutes/hours per update) Example: Twitter's search API is limited to 15 queries of 100 Tweets every 15 minutes. Do you query 100 Tweets every minute, or 1500 Tweets every 15 minutes?
- jaredsohn 13y agoOne other challenge is that some of the presentation (especially portions of the front page) isn't data-driven. It can be tricky to figure out which information to highlight, what the clustering topics should be, etc.
- babs474 13y agoI've got an experimental, realtime comment search engine over at commentfindder.com. Perhaps some useful visualizations could be created off of it. Do you have any ideas for what kind of actionable chart would be interesting?
- frakkingcylons 13y agoFor how long did you collect data? During previous crawls, I've found that one of my spider bots can scrape through about 11.5k submissions and 51k comments per day (while observing Reddit's API access rules).
- deleted 13y ago[deleted]
- ctide 13y agoNothing like a bunch of comments tearing apart a website built by people who, presumably, learned to code a few months ago and threw it together over the course of a few weeks. Yeah, it has a few issues, but it's significantly better than the first things I ever built and sent off to the world. Keep it classy, HN.
- scholia 13y agoIt's fundamentally horrible. The whole design approach is horrible. It's the contemporary equivalent of GeoCities, just using more recent but equally mindless design cliches. In fact, it's so horrible it makes PowerPoint look good.
- shawndrost 13y ago(For parties that wanted to downvote this comment more than once: you can do so by clicking "link", then clicking "flag".)
- MichaelApproved 13y agoFrom your profile: "Cofounder of a dev training program called Hack Reactor" Hacker Reactor is where this website originated from and you're behaving this way? You've been a HNer for over 2,000 days. You should know better.
- deleted 13y ago[deleted]
- deleted 13y ago[deleted]
- foobarbazqux 13y agoYour criticism is fundamentally horrible. The whole rhetorical approach is horrible. It's the contemporary equivalent of a flame on USENET, just using more recent but equally mindless rhetorical cliches. In fact, it's so horrible it makes YouTube comments look good.
- deleted 13y ago[deleted]
- visarga 13y agoThis is great and all, but if there is one tool I'd like to see is a personal data exporter. I want to get all the posts and messages I have ever posted, going back many years, and beyond the 1000 cutoff in their comment history feeds. I'd like to run some keyword analysis on my own data, search it, access it however I see fit. As it stands now, there is no way to retrieve it.
- gdi2290 13y agoThanks for your feedback, but what you're asking for Reddit doesn't provide in their API