4 ms·
The most similar thing I've found is Apache Beam[1] which allows you to run ETL code on multiple engines but doesn't necessarily come with off the shelf integra
by haney 10y ago
The most similar thing I've found is Apache Beam[1] which allows you to run ETL code on multiple engines but doesn't necessarily come with off the shelf integrations for commercial products. As far as "how ETL is done today" it's definitely going through changes Airflow[2] is a popular open source tool that can run ETL pipelines but it's more of a task runner so again you're writing your own extraction and loading logic for things off the shelf CRMs and Accounting tools. I'm excited to not have to write extraction scripts for third party tools that I'm sure other people have also written. Very cool project.
1. https://beam.apache.org/ https://beam.apache.org/
2. https://airflow.incubator.apache.org/ https://airflow.incubator.apache.org/