3 ms·
Interesting, thanks, we weren't aware of Metaflow. I've read through the docs, the one difference that comes to my mind is the automatic fallback to on-Demand
by vishnukool 5y ago
Interesting, thanks, we weren't aware of Metaflow.
I've read through the docs, the one difference that comes to my mind is the automatic fallback to on-Demand and resume back to spot when available. I can't readily see a way to do this yet in Metaflow, but it's possible I've missed something.
- vtuulos 5y agoThere are a few different ways to deal with spot interruptions. First, it is a good idea to specify multiple instance types in your compute environment so even if some instances types become unavailable in spot, Batch can use another type automatically. Second, you can rely on Spot Fleets which handle both spot and on-demand instances seamlessly https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet.html https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fle...