4 ms·
I would make use of ETL-as-a-service vendors as much as possible (Stitch, fivetran, etc.) before going to airflow/prefect for the more custom stuff. Airflow 2.
by theboat 6y ago
I would make use of ETL-as-a-service vendors as much as possible (Stitch, fivetran, etc.) before going to airflow/prefect for the more custom stuff.
Airflow 2.0 will have some pretty nice features for ML development as well.
- FridgeSeal 6y agoI'm so very hesitant of workflows-as-a-service: they just seems like a fantastic way to get really locked-in to some incredibly specific vendor; add in the fact that if you're required to maintain geographical-jurisdiction of your data, or you have constraints about 3rd-parties having access to your data then you're more-or-less out of luck. Also they all seem to charge so very much for what amounts to a fairly straightforward service...