Metaflow integrates with AWS Batch which many folks use for serious HPC. Internode scheduling happens through the multinode scheduling supported by AWS Batch.

Metaflow integrates with AWS Batch which many folks use for serious HPC. Internode scheduling happens through the multinode scheduling supported by AWS Batch. networking via EFA etc. We'll blog more about this soon but you can certainly give it a try today! https://github.com/outerbounds/metaflow-ray https://github.com/outerbounds/metaflow-ray