24 ms·
Reminds me of the xkcd "how standards proliferate" Arguably you could use Kubernetes as a scheduler, or "ETL framework/kit", it supports cron jobs, has a restf
by hadlock 5y ago
Reminds me of the xkcd "how standards proliferate"
Arguably you could use Kubernetes as a scheduler, or "ETL framework/kit", it supports cron jobs, has a restful api, local and remote secrets storage, native support for cloud storage, support for multiple logging solutions, distributed workloads, supports cron jobs etc.
Years ago I worked for a financial services company and they would run their batch ETL jobs via a product called Tidal that later got bought by Cisco. I really liked using Tidal for the longest time, but 100% of what Tidal does, you can replicate with the scheduler features of Kubernetes.