3 ms·
I work as a data scientist but want to learn more about data engineering and software engineering as I prefer those aspects of the work. Hadoop seems outdated
by alexgmcm 7y ago
I work as a data scientist but want to learn more about data engineering and software engineering as I prefer those aspects of the work.
Hadoop seems outdated now though as we have moved to the Cloud whereas we used to have Hadoop on-site and it seems most of my friends companies have done the same.
- dataguy12 7y agoAwesome! Then we will work on that. Yes, Hadoop is kind of weird. Like most companies use it through the abstraction of hive or presto. So..it's just SQL again.
- kthejoker2 7y agoMy two cents is there's still a lot of design patterns and methodologies to pick up on in MapReduce and distributed data architecture. If we're including movement and integration, ETL/ELT, sharding, partitioning, etc in data engineering...?