4 ms·
That's how we define it where I work. Data engineering cleanse data, manage workflows for ETL, build views, encapsulate rules and logic. Data science is takin
by kthejoker2 8y ago
That's how we define it where I work.
Data engineering cleanse data, manage workflows for ETL, build views, encapsulate rules and logic.
Data science is taking that cleaned up data and testing hypotheses.
Plenty of people can do both, and frankly it's very condescendimg when I run into a data scientist who prefers to outsource the engineering (because they're bad at it) so they can do "real work."
Source: I hire data scientists for Fortune 100 companies.
- geezerjay 8y ago> Data science is taking that cleaned up data and testing hypotheses. Dimensionality reduction is a big part of data science, and it tends to be far more important than data cleanup and outlier detection as it dictates which modeling methods are viable in practice given your resources.