3 ms·

Our data scientist left because instead of data science, he ended up doing more ETL and data engineering support than what he originally had signed up for. A f

Our data scientist left because instead of data science, he ended up doing more ETL and data engineering support than what he originally had signed up for. A full-time data engineer should probably have been hired. I wonder if this leads to an analogous discussion as http://wiki.c2.com/?ArchitectsDontCode http://wiki.c2.com/?ArchitectsDontCode.

crescentfresh 9y ago
Not too familiar with the data-this, data-that space. What does a data engineer do? What does a data scientist do? Does either code?
- amrrs 9y ago
  Yes, Ideally, A data scientist works on creating the model or logic while a Data Engineer works on the part of deploying the same.
- ct0 9y ago
  They both code. The engineer would pull the data from various sources and structure it in a way that the data scientist is happy with. (Tidy format) The DS would the code the models based on the engineer's work, which takes considerably less time.
- altstar 9y ago
  In our environment, the scientist builds the models, the engineer makes them run. Both can code (the scientist to build models, the engineer to execute models).
- RHSman2 9y ago
  One does math based hypothesis’s and the other moves data around and compute’s hypothesis’. Making a dashboard is not data science. At all.
ct0 9y ago
I know someone who is hired as a data scientist and is mostly doing the same ETL work. The science is literally 10% of the work anyway, and all DS should know that.
js8 9y ago
Dammit, Gartner, make up your mind! You told me last year that one data scientist is gonna solve all my problems. Now you're telling me I need to babysit him with five data engineers, because he is not going to get his hands dirty with data??
megaman22 9y ago
Nobody ever gets to do the fun parts of their job. Who would sign up if they told you up front that your main contributions would be shuffling email, filling out TPS reports, attending pointless meetings, and being roadblocked every time you tried to automate, eliminate, or improve that drudgery? You can smash your head against the wall trying to make things better, but all that ends up doing is pissing you off and giving you a headache.

crescentfresh 9y ago

Not too familiar with the data-this, data-that space. What does a data engineer do? What does a data scientist do? Does either code?

amrrs 9y ago
Yes, Ideally, A data scientist works on creating the model or logic while a Data Engineer works on the part of deploying the same.
ct0 9y ago
They both code. The engineer would pull the data from various sources and structure it in a way that the data scientist is happy with. (Tidy format) The DS would the code the models based on the engineer's work, which takes considerably less time.
altstar 9y ago
In our environment, the scientist builds the models, the engineer makes them run. Both can code (the scientist to build models, the engineer to execute models).
RHSman2 9y ago
One does math based hypothesis’s and the other moves data around and compute’s hypothesis’. Making a dashboard is not data science. At all.

ct0 9y ago

I know someone who is hired as a data scientist and is mostly doing the same ETL work. The science is literally 10% of the work anyway, and all DS should know that.

js8 9y ago

Dammit, Gartner, make up your mind! You told me last year that one data scientist is gonna solve all my problems. Now you're telling me I need to babysit him with five data engineers, because he is not going to get his hands dirty with data??

megaman22 9y ago

Nobody ever gets to do the fun parts of their job. Who would sign up if they told you up front that your main contributions would be shuffling email, filling out TPS reports, attending pointless meetings, and being roadblocked every time you tried to automate, eliminate, or improve that drudgery? You can smash your head against the wall trying to make things better, but all that ends up doing is pissing you off and giving you a headache.