4 ms·
As of today, Metaflow supports AWS Batch for scaling out and up. While supporting K8S is convenient in the operations point of view (assuming you have a K8S clu
by vtuulos 6y ago
As of today, Metaflow supports AWS Batch for scaling out and up. While supporting K8S is convenient in the operations point of view (assuming you have a K8S cluster already), it doesn't make the scalability story any better.
- sandGorgon 6y agosure - im not talking about scalability from a science perspective, but really from practical applicability perspective. Most people already are running k8s of some kind. I beginning to see k8s increasingly as an invariant. Plus not all of us are on AWS. Secondly, AWS Batch is only applicable for metaflow for ml training.