3 ms·
And where would you recommend someone to start a data engineering path. Any book, learning source?
by pricci 6y ago
And where would you recommend someone to start a data engineering path. Any book, learning source?
- thecolorgreen 6y agoI have the same question and I believe the answer is in the same vein as someone who asks about software engineering. Books/courses are great for the concepts, but your goal should be to build something ASAP since that's where actual learning will come from.
- Karrot_Kream 6y agoA lot of these are just "garden variety" (distributed) systems problems. Dealing with systems with differing latency distributions, recovering from failure, acceptable tradeoffs between speed and accuracy, etc
- khaledh 6y agoWork at a company that has a good data engineering discipline. Shopify is hiring: https://www.shopify.ca/careers/2021 https://www.shopify.ca/careers/2021
- edmundsauto 6y agoLong time DE here. I recommend trying to build your own data warehouse around something you're interested in. Don't worry about teh scaling - focus on the core engineering, taking data from different places, combining it into a sensible data model, update it automatically every day. Add in more sources. It's shockingly difficult, and something that only experience can teach.
- Avalaxy 6y agoThe book "designing data-intensive applications" is really really good, and covers all the concepts (although not per sé the tools) you need to understand.