6 ms·
The actual problem with learning "data science" is making inferences and conclusions which do not violate the laws of statistics. I've seen many submissions to
by minimaxir 11y ago
The actual problem with learning "data science" is making inferences and conclusions which do not violate the laws of statistics.
I've seen many submissions to Hacker News and Reddit's /r/dataisbeautiful subreddit where the author goes "look, the analysis supports my conclusion and the R^2 is high, therefore this is a good analysis!" without addressing the assumptions required for those results.
Of course, not everyone has a strong statistical background. Except I've seen YC-funded big data startups and venture capitalists commit the same mistakes, who should really, really know better.
"Data science" is a buzzword that successful only due to obscurity and no one actually caring if the statistics are valid. That's why I've been attempting to open source all my statistical analyses/visualizations, with detailed steps on how to reproduce. (see my recent /r/dataisbeautiful submissions on reddit: https://www.reddit.com/user/minimaxir/submitted/ https://www.reddit.com/user/minimaxir/submitted/ )
- liviu- 11y ago>see my recent /r/dataisbeautiful submissions on reddit: https://www.reddit.com/user/minimaxir/submitted/ https://www.reddit.com/user/minimaxir/submitted/ They all seem very well-presented[0], but I can't help but ask - what do you do with this new information? [0] https://i.imgur.com/PvWYB2n.png https://i.imgur.com/PvWYB2n.png
- minimaxir 11y agoI am planning a blog post on the relationship between YouTube video duration on other statistics. So I did a little exploratory analysis to validate the data. As shown, the distribution of durations in Music videos is much, much different than all other categories. As a result, it skews nearly every other analysis and I may have to exclude videos from the Music category entirely.
- probdist 11y agoThe classic venn diagram of data science is still helpful: http://drewconway.com/zia/2013/3/26/the-data-science-venn-diagram http://drewconway.com/zia/2013/3/26/the-data-science-venn-di... This article reads like a way to find yourself in the danger zone.
- ForHackernews 11y agoWhat if you just want to get paid well to play with interesting tools?
- jwuphysics 11y agoI've never seen this venn diagram before--thanks for bringing it up. I find that, as an academic (pursuing a Ph.D. in astrophysics) that plenty of traditional researchers are able to hack together code (many haven't ever taken a formal programming course; http://arxiv.org/abs/1507.03989 http://arxiv.org/abs/1507.03989) but many also misuse or can't interpret statistics (from personal experience). That puts us in the danger zone! I think the key is to find the mathematics and statistics interesting because you want the [data] science to be meaningful. If that's a driving force, then you can learn math and statistics on your own (like the author did). Otherwise, yes--you will find yourself in the danger zone.
- curiousjorge 11y agowhat you described is prevalent in social sciences. Ton of biases and causation/correlation error and putting blind trust in some arcane statistical analysis without knowing what they really mean. Conclusion: statistically significant is the magic word peppered throughout academic literature.
- achompas 11y agoAgreed. Fortunately, excellent social scientists really care about this -- see Andy Gelman's blog for many rants on this topic.
- Balgair 11y agoI'll echo for biology and sports sciences (think moneyball). http://www.wired.com/2009/09/fmrisalmon/ http://www.wired.com/2009/09/fmrisalmon/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1182327/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1182327/
- facepalm 11y agoI assume data science is often used in place of astrology. People just want to have something to cling to, to get over their fears and insecurity. So if you can generate some reassuring graphs, who cares if they are based on solid statistics or not?
- forgetsusername 11y ago>People just want to have something to cling to, to get over their fears and insecurity. The other side of this is that some businesses (especially SMBs) are so horrible at utilizing their data that very basic analyses can reap big gains (80/20 rule!). For the vast majority of businesses there is no need for elaborate models or machine learning techniques.
- washedup 11y agoIt's dangerous to make big generalizations like "no one actually caring if the statistics are valid." This simply is not true. Sure, a lot of what you see on /r/dataisbeautiful is garbage, but that's because it's an open forum where anyone can show what they think they have found. Usually, whenever someone makes an egregious statistical error, they are called out for it. Of course, the same happens on larger scales and even in published research. "Data science" at it's core is just statistical analysis, but it has been slowly morphing over the past few decades thanks to the budding field of machine learning and the commoditization of computing power. This has drastically changed the field of statistical research, and although the underlying math is the same, the tools and the amount of data are constantly in flux. Someone along the way must have felt that this evolution of statistical analysis needed a new name. In all honesty, it's just a name, and it doesn't matter. What matters is if you understand how to use it.
- nabla9 11y agoRoughly 80% of data scientists I know have PhD in something very math heavy. Rest have masters degrees. There are programmers who can assist them doing the grunt work but it's just basic programming to assist analysts to crunch data. If you want to do data science for real: 1. Get Masters of PhD from statistics, computer science, economics, physics or some other heavy field and specialize data analysis in that field. You must learn lots of statistics when doing so. 2. Learn programming, statistical machine learning and tools of the trade. Good data science is not based on collecting large amounts of data passively and then mining it mindlessly. You need to ask right questions and design data collection and modeling process based on those questions.
- dworin 11y agoI've seen a huge range in the people calling themselves data scientists. Some have very analytically intensive academic degrees, others just finished a data science boot camp, and there are a lot of people that used to be called 'business analysts' who are basically doing the same job with a fancier title. In every group, I've had people tell me that what they're doing is really data science, because data science needs the (academic|integrated|business) perspective that they have, and what the other people are doing isn't really data science.
- qq66 11y agoAcademic credentials aren't enough, good data-driven decisionmaking is as much an art as an academic discipline. A p-value of .01 is a Nobel Prize in medicine and unpublishable in physics -- domain knowledge is important to have a feel for the difference.
- whistlerbrk 11y ago> Good data science is not based on collecting large amounts of data passively and then mining it mindlessly. You need to ask right questions and design data collection and modeling process based on those questions. This resonates. That is, picking and designing features. Also understand dependent variables and knowing how to test for that, which is the biggest mistakes leading to flawed conclusions I see from the 'general public'.
- deleted 11y ago[deleted]