3 ms·
> the engineering-related department consuming the ETL’s output should likely be the ones writing/maintaining it. This is exactly the author's point. The Data
by liamconnell 8y ago
> the engineering-related department consuming the ETL’s output should likely be the ones writing/maintaining it.
This is exactly the author's point. The Data Scientists are consuming the ETL's output, so they should learn how to write and maintain ETL since it isnt very hard or time consuming with modern tools.
- WorldMaker 8y agoThough this backfires sometimes for the engineering department in that then the engineers get forced into an "inner-platform effect" problem that they instead have to build an ETL platform abstracting enough ETL abilities for their company's data scientists' skill level, yet generic enough for their company's data scientists' arbitrary questions/needs. That is its own soul-sucking experience. "Can't we just hire people that can learn Power BI better? Why are we still writing data tools for people that think they know Access but barely know Excel?"