5 ms·
if you really understand ML/DS, then you would know that ML is founded on all the same concepts. > "... they tackle data is radically different from statistici
by autokad 8y ago
if you really understand ML/DS, then you would know that ML is founded on all the same concepts.
> "... they tackle data is radically different from statistician ..."
the short answer is, before we had limited data, compute, and the problems businesses needs increased substantially.
now we can do better things, and if you cant do more than what companies were doing in the 1950s, then your value proposition is significantly less than someone that's using industry practices established in 2017 / early 2018.
> "I wish statistic is better at marketing. Oh well."
as a data scientist, I have to know stats, ML, big data tools (spark/splunk/hdfs), programming, and domain specific knowledge. some data scientists are just rebranded statisticians, which is fine. the role of a data scientist varies to the needs of the org they are in. I mostly do anomaly detection and classification, while others may focus solely on AB testing.
> > "> why can't data science simply be about applying the scientific method in the realm of data analysis?"
the statement doesnt make sense to me. if you are doing data analysis then by default you are doing observations and measurement on empirical data.
As far as experimentation goes, almost no one has the resources or the standing to do that. Some do, like those AB testers I mentioned before.
> "Actually my last day of internship I've met a few statistician interns some of them are from Cal (UCBerkely) and they came to the same conclusion (we have a lot of complaints). The ML/DS group is really just doing black magic (nicest way of putting it)"
Then they don't appreciate ML and the problems they are trying to tackle. It reminds me of a stats PHD co-worker that was upset about the number of parameters in an image classification problem we had. they didn't think a model could be ran that had more parameters than observations.
I was like we are not running linear models ... As an experiment, go to kaggle and try the spooky author classification competition. See how far you can get with basic stats and then see how much further you can get with ML. hopefully it will give you an appreciation for some of the ML tools available.
It's not black magic, like many other domains; its just a dense subject that takes a lot of time to understand
- 3pt14159 8y agoYeah, most of this thread has kinda garbage responses. Even if you did a CS degree and then did a BMath with a statistics major you still wouldn't have all the skills you would need, though you'd have a great place to start off from. There is an art in kinda guiding / interpreting the mathematics that's hard to teach and most people in the field kinda pick it up through experimentation. I'm sure it will get more formalized at some point, but I don't think the formalization will be all mathematical or scientific; I think much of it will be making explicit how to think about certain domains or a system of process that are useful. Also I think there is a big difference between Data Engineers, Data Analysts, Data Scientists, and AI researchers. Depending on the field, an AI researcher deals more with idealized forms and is much stronger on the mathematics of machine learning. Data engineers are usually stronger on the CS topics that deal with scale. Data analysts, even the very best ones, tend to be weaker on the CS, the math, but tend to be the strongest at quickly understanding data and making it intelligible to decision makers. I'm not knocking it—I was an analyst at one point—it's just the truth that some positions take more skill than others and most great data analysts tend to treat it as a 3 or 5 year stop before levelling up to management or a more technical role. Data Scientists generally have the skills of a data analyst (though they have trouble dumbing things down at times if they came here from something other than an analyst position) with some of the skills from the other two. The way some application code software developers dismiss a whole sub-discipline is kinda embarrassing.
- sizzle 8y agoIs business intelligence considered data science? I've never really understood. Thanks.