Tried some of them, threw them away for various reasons and used Argo Workflows instead. Airflow mixes orchestration and the actual transformation, and I wasn’

Tried some of them, threw them away for various reasons and used Argo Workflows instead. Airflow mixes orchestration and the actual transformation, and I wasn’t a fan of being ao intimately tied to Python. Argo let’s us run arbitrary containers (a mix of Spark, Rust, etc) and played nicer with the tools we were already using (Kafka, K8s etc), didn’t require us to write Python and cleanly separated orchestration and actual ETL/ELT work. It’s working fantastically for us.