4 ms·
I would simply dockerize the Airflow tasks and keep them in JS as-is. Then you write the short DAG description in Python but make the task executor launch the
by LunaSea 2y ago
I would simply dockerize the Airflow tasks and keep them in JS as-is.
Then you write the short DAG description in Python but make the task executor launch the Docker containers.
And then you're done.
- viceconsole 2y agoThis was my immediate thought. Just because Airflow is written in Python doesn't mean the tasks you're running need to be in Python. Separate the concerns: migrate the task orchestration to Airflow (or whatever) while keeping the actual Javascript task code largely unchanged.