3 ms·
What are the skill sets required? Proficiency in SQL seems like an obvious one but else needs to be in the toolbox so to speak?
by bogomipz 5y ago
What are the skill sets required? Proficiency in SQL seems like an obvious one but else needs to be in the toolbox so to speak?
- RhodesianHunter 5y agoKafka is a very useful one.
- beckingz 5y agoCore is SQL + Python (or Java/Scala for the actual Engineering part). Most of the data warehouse work is data transformation and scheduling, so Apache Airflow and writing DAGs in python is a large part. For some of the larger streaming things you've got Kafka and others. Also every cloud has it's own stack that is sometimes worth using.
- bogomipz 5y agoThanks, what's the name of the AWS stack? Is it worth using?