I'm kind of surprised at seeing kubeflow vs metaflow levels of abstraction honestly. If you are indeed talking from a data scientist POV - then the right abstr

I'm kind of surprised at seeing kubeflow vs metaflow levels of abstraction honestly. If you are indeed talking from a data scientist POV - then the right abstractions here are Dask and Ray Distributed. Both can run on Kubernetes as the underlying orchestration layer - but are a pythonic interface to distributed data science primitives.