3 ms·
>> I've been looking for jobs recently, and I've seen only one job posting that mentions data cleaning as a necessity, whereas the rest only talk about data sci
by eanzenberg 10y ago
>> I've been looking for jobs recently, and I've seen only one job posting that mentions data cleaning as a necessity, whereas the rest only talk about data science and algorithm knowledge, or overall ETL design on the data engineering side. Seems like data set knowledge should be emphasized more.
Actual data cleaning, usually in an automated sense, is more 'data engineering' than 'data science' or applied statistics. Feature engineering and 'massaging' training data is more related to DS but it's understood that this data being consumed by the DS is already in decent shape.
- IanCal 10y agoI'd hesitate to call a lot of the work I do cleaning data "engineering". I think perhaps the problem here is the term science covers a lot of disciplines. I propose harder stats be data theoretical physics, with data biology and similar referring to cases with harder messy real world complications. I'm sure we can come up with a full spectrum.
- dasboth 10y agoThat also depends on the team. If your company has dedicated data engineers, great! Otherwise you're probably stuck with it.