2 ms·

That doesn't answer the question. When I hear the term data scientist, I assume that the person has extensive training and background in statistics and mathema

That doesn't answer the question. When I hear the term data scientist, I assume that the person has extensive training and background in statistics and mathematical modeling. I work with large data sets all the time as a scientist and can run all the standard statistical tests but I would hardly consider myself a data scientist.

agibsonccc 12y ago
Realistically, most "data scientists" that people hire aren't going to have that full background. I think the problem with a lot of data science teams out there today is the hiring. Not a lot of people understand what the role of a data scientist should be and they expect these people who can do hadoop end to end, extensive CS skills, know all of the latest advanced machine learning algorithms, and know stats like the back of their hand. Many employers will not need or use that full pipeline, and if they do, they are probably capable of hiring hadoop engineers as well as more traditional analysts who are deeper in the math with the models. That analyst is someone with a specialized background and some form of training in scientific computing. This does not need to be a full blown masters/phd. Realistically, you can get away with having a decent programming background, a clue about the landscape of the machine learning algorithms, and enough statistics to know when you're going down a rabbit hole with respect to research. I think it more comes down to having the right mindset with problem solving. Much of this is also going to be domain specific. The term data science is ambiguous at best, as it is a new field. I think over the next few years we'll come to see more specialized roles over time that will help clarify the sandbox that is data science vs data engineering among other disciplines.

2 ms·

That doesn't answer the question. When I hear the term data scientist, I assume that the person has extensive training and background in statistics and mathema

by cabinpark 12y ago

agibsonccc 12y ago
Realistically, most "data scientists" that people hire aren't going to have that full background. I think the problem with a lot of data science teams out there today is the hiring. Not a lot of people understand what the role of a data scientist should be and they expect these people who can do hadoop end to end, extensive CS skills, know all of the latest advanced machine learning algorithms, and know stats like the back of their hand. Many employers will not need or use that full pipeline, and if they do, they are probably capable of hiring hadoop engineers as well as more traditional analysts who are deeper in the math with the models. That analyst is someone with a specialized background and some form of training in scientific computing. This does not need to be a full blown masters/phd. Realistically, you can get away with having a decent programming background, a clue about the landscape of the machine learning algorithms, and enough statistics to know when you're going down a rabbit hole with respect to research. I think it more comes down to having the right mindset with problem solving. Much of this is also going to be domain specific. The term data science is ambiguous at best, as it is a new field. I think over the next few years we'll come to see more specialized roles over time that will help clarify the sandbox that is data science vs data engineering among other disciplines.