We've had much success with Argo workflows over the past months. Among other projects, we use it to generate city-sized extracts of mapping data from the OpenSt

We've had much success with Argo workflows over the past months. Among other projects, we use it to generate city-sized extracts of mapping data from the OpenStreetMap planet. Blog post at https://www.interline.io/blog/scaling-openstreetmap-data-workflows/ https://www.interline.io/blog/scaling-openstreetmap-data-wor... Using Argo on Google Kubernetes Engine makes it easy to auto-scale for our workflow steps that parallelize. We're also able to reuse Dockerfiles and resources between both our batch workflows and our running services (also on Kubernetes).