4 ms·
At Grove we make extensive use of KubernetesPodOperator[0]. This allows to both encapsulate the job in containers (k8s pods), and also specify the resources we
by numlocked 5y ago
At Grove we make extensive use of KubernetesPodOperator[0]. This allows to both encapsulate the job in containers (k8s pods), and also specify the resources we need for each DAG.
[0] https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/operators.html https://airflow.apache.org/docs/apache-airflow-providers-cnc...