>If I need a for-loop, I'll write my own script to generate the JSON. That's how you end with extreme mess in logs, UI and metrics. > But with Airflow, you ne

>If I need a for-loop, I'll write my own script to generate the JSON. That's how you end with extreme mess in logs, UI and metrics. > But with Airflow, you need to figure out what _Airflow_ operator and method wraps the Google SDK method you're trying to call. Or you can use PythonOperator with hooks, that generally integrate external APIs with Airflow connection system. https://github.com/apache/airflow/blob/main/airflow/providers/google/cloud/hooks/gcs.py https://github.com/apache/airflow/blob/main/airflow/provider... I think the bigger problem with Airflow's Operator concept is N*M problem of integrating multiple systems. That's how you end with GoogleCloudStorageToS3Operator and stuff like that.