4 ms·
Airflow but use KubernetesPodOperator so you can run your ETLs in docker containers or pods within k8s (any language you want). You may need to write a few line
by iknownothow 4y ago
Airflow but use KubernetesPodOperator so you can run your ETLs in docker containers or pods within k8s (any language you want). You may need to write a few lines of dumb python code to build a DAG of KubernetesPodOperators but the actual work is done within containers.
- dirtbag__dad 4y agoPretty cool, thanks for sharing. I have no personal experience with k8s, so from what I gather seems we could achieve something similar with serverless functions instead of containers?