4 ms·

Doesn’t the latest version of k8s let you use your own custom scheduler?

• paulgb 4y ago
  You can, but that falls into this bucket: > the more we tried to optimize it the less of core Kubernetes we were using and so the less value we were getting for the complexity tax we were paying Since we were headed down that path, we took a step back and asked what we were really getting out of Kubernetes, and most of it was things that were orthogonal to our intended use case. The way Kubernetes is architected around control loops works great for its intended use case, but we wanted a more event-driven system.
  • hosh 4y ago
    Event driven ... like a streaming data pipeline? Given your comment about Jupyter notebooks, that makes sense. It might be the Mesos project is better architected for your use-case. Then again, I think Mesos ported some of their schedulers to Kubernetes.