4 ms·

kubernetes.

• shoo 7y ago
  Can you go into more detail? I understand k8s might be a fairly reasonable way to start and supervise a large number of services, and I've seen it used to execute one-shot batch jobs. But I can't quite join the dots to see how you could have a distributed job processing system with just k8s. Would you need to use some other system (perhaps also running in k8s) to track the queue of tasks and store task status & task results? Or can you get k8s itself to act as the task queue?
  • pookeh 7y ago
    Have a look at Argo if you are interested in leveraging k8s infrastructure https://github.com/argoproj/argo/blob/master/README.md#what-is-argo-workflows https://github.com/argoproj/argo/blob/master/README.md#what-.... For us, we settled with Netflix Conductor as it scaled pretty well and allowed us to have pretty complex workflows and error paths and retry logic. Also is an independent and standalone tech.