4 ms·
I'm sure someone can come along with a better description, but it's kinda like devops/sysadmin but specifically for data storage and access. You could also loo
by nerdponx 10y ago
I'm sure someone can come along with a better description, but it's kinda like devops/sysadmin but specifically for data storage and access.
You could also look it up...
- mehaveaccount 10y agoThat's a good description for a data engineer from my end.
- xapata 10y agoI'd include database engineer in that bin. We used to call people DBAs but that seems a bit limiting now.
- sdenton4 10y agoAt some point, people realized that 90% of data science work was building pipes and keeping them clean. And then data engineering was invented so that the data scientists wouldn't have to get their hands as dirty. :)
- fnord123 10y agoA snappier version which gives the flavour: Data scientists use {tensor flow, scikit-learn, parquet, hadoop, spark, scrapers, etc}. Data engineers write {tensor flow, scikit-learn, parquet, hadoop, spark, scrapers, etc}.