7 ms·
While there certainly is a lot of data, and it is presented very well, the analysis falls into the same traps as analyses of Google Trends data, particularly in
by minimaxir 11y ago
While there certainly is a lot of data, and it is presented very well, the analysis falls into the same traps as analyses of Google Trends data, particularly in the keyword analysis. Causation of changes in trends is ambiguous.
For example, YC applications are optimized for the highest probability of getting into YC by definition, and so it would be expected that terms on the application would be optimized for getting venture capital, not necessarily what is happening in the marketplace today. (The "Slack: King of the Enterprise Tools" slide is a good example; I'm sure the mention of "Slack for X" is a golden flag for some VCs)
A question about the chart presentation: why are some lines straight, and some lines smooth? (e.g in the Startup Competitors slide, Instagram, Airbnb, and Uber have curbed lines but Tinder, Whatsapp, and Snapchat have straight lines)
- jsprogrammer 11y agoThe analysis is limited to statements of what was observed in YC applications, not what is happening in the larger marketplace. This is exactly what you get when you look into a crystal ball: a warped view of your local environment.
- taneq 11y ago> This is exactly what you get when you look into a crystal ball: a warped view of your local environment. I love it. I'm stealing this. :)
- deprave 11y agoFully agree. It's unfortunate that these "trends" are actually trailing and imitating recent successes. It only goes to show that VCs (YC included) don't shape the future of technology, but rather try to squeeze money from their own investors by pitching ideas that relate to things they hope the latter are familiar with thanks to news coverage.
- imacat 11y agoYes, it also shows how volatile people are when it comes to doing a startup. I understand the usefulness of pivoting, but as it stands, people are pivoting across entire industries (into industries where they are completely inexperienced) for the sake of getting funding. Some cross-pollination between industries is beneficial, but right now you have too much of it - It turns everyone into a snake oil salesman - All bling no substance... Everybody knows a bit about everything but nobody knows everything about anything. YC encourages a breadth-first mentality which is subpar when it comes to encouraging deep innovation. The YC decision process should be seen like a decision tree with the minimax (adverserial search) algorithm switched on... Applicants are YC's opponents, not their ally and they are always looking for ways to subvert the system.
- Alex3917 11y ago> I'm sure the mention of "Slack for X" is a golden flag for some VCs It's crazy how many people in the industry believe that Slack is already more popular than email, is close to overtaking email, or is growing faster than email. The stupidity in tech has reached the level of being a moral hazard, where it really just incentivizes everyone else to be bad at their jobs.
- rfrank 11y agoI truly don't understand the hype around Slack. I work at an EMS provider, and we got a couple of our business facing teams to use it last fall. Maybe 2 people are actively using it now, the rest moved back to only email or never actually used Slack in the first place.
- brazzledazzle 11y agoI've noticed a lot of business/corporate people really don't "get" slack the same way an older person is bewildered by something like snapchat. We have a "legacy" (for lack of a better term) Lync system that they are holed up in and the split along those lines is very noticeable. Those same type of people who are on the teams firmly on the slack side tend to stay offline until they get an email notification, answer the mention or DM and then disappear again.
- bobwaycott 11y ago> the same way an older person is bewildered by something like snapchat. Damn. At just (now) 35, I'm apparently an "older person". /me pours another glass of bourbon
- camillomiller 11y ago31 and feeling the same. Snapchat is the most effective generation splitter I've ever seen
- 11y ago
- noahmbarr 11y agoThere's a larger statistical significance issue here. Check the different scales + the degree of certainly is even worse when the you're talking about minute changes to a fraction of a percentage, year-over-year. Made a quick file to illustrate: https://www.dropbox.com/s/uq0apjt69zadiii/YC%20Blog%20Resized%20graphs%20examples.pdf?dl=0 https://www.dropbox.com/s/uq0apjt69zadiii/YC%20Blog%20Resize...
- minimaxir 11y agoThe axis scales are fine as long as the comparisons are apples-to-apples. Since the charts were split between startups and nonstatups, I believe it's fair. The "statistical significance" issue with using small percentages is fine as long as the sample size is sufficiently large. YC receives thousands of applications each year, which is enough... ...although in 2016, there's only been 1 round of applications so far, whereas other years have 2 rounds of data. Therefore the sample size might be smaller, which can create doubt in the "Slack is 850% better" conclusion. Again, I do not know the exact sample size to verify.
- noahmbarr 11y agoI get persuasive writing, but calling "Slack: King of the Enterprise Tools" because it went from 0% in 2014 to 1.2% in 2016 is absolutely an over statement. Apples-to-apples on the chart? I'd bet a Tubman that 70%+ of the readers didn't catch the scale differences as they went chart-to-chart, following the writer down his/her path. Everyone draws the line somewhere on this stuff, and I'm just surprised where Priceonomics (who's stuff is normally AWESOME) and YC placed their collective line. Then again, maybe I'm all alone out here with this concern. ---------- *If that wasn't bad enough, did they search for other potential "enterprise tools" or just the ones that are trending today? Curious if Yammer, MS Excel, MS Office, Jira, charted in an "significant" way?
- cik2e 11y agoWith a couple of thousand applications per year, each one of those small percentages is going to have a 95% bound in the neighborhood of +/-0.5%. The closer a fraction is to 0 or 1, the more significant it is per given denominator. The bounds on some of these will certainly overlap y/y but the large swings over a few years are very much statistically different. Also, if this analysis is on the full population of YC apps, there's no statistical error if you take it for what it is: trends within YC apps. Not every metric needs to be extrapolated to the maximum feasible population to be interesting. Finally, the scales on the two graphs you resized shown changes of a factor of 5-7, not counting the first data points, otherwise even more. I'd argue that your scales are the ones that are misleading in this scenario. You'd be right if they had that scale for an 82% to 94% growth, vs. the 2% to 14% or .2% to 1% that they are illusrating.
- notsotrue 11y agoWell, the terms section is certainly misleading. I prefer to see data where the plural is grouped with the singular. Looking at the chart, VR ranks above drone(s). VR has no commonly used plural, so without combining singular and plural terms, and without the raw numbers displayed, it's not a useful chart.
- tedmiston 11y agoI'm incredibly surprised they didn't use stemming to combine singular/plurals consistently. It's totally standard in information retrieval.
- forgetsusername 11y agoI appreciate your contributions to HN and am interested that you're skeptical(?) as well. We're looking at a few "wowee!" graphs that are showing the differences between fractions of a percent. I mean, the claim is "850% growth" of Slack... as it goes from 0% to 1% of "mentions" in some randomly associated keyword analysis. "AI" went from 0.41% to 0.7% of "mentions" in 4 years, looks like it's taking over! Blogging is no longer popular, because it went from 1.5% to 0.5%, but "messaging" is so popular now because it went from...zero to 1%? What does any of it mean? It looks like the type of analysis where the conclusions are drawn ahead of time. I'd be more interested in seeing the diversity of replies; if only a small fraction of companies see, say, the big guys (FAANG) as competitors, who do the rest list?