3 ms·

Here are your numbers for spot instance pricing[1]. Machine learning stuff will typically happen in batches, openai even went through the effort to publish a k

Here are your numbers for spot instance pricing[1]. Machine learning stuff will typically happen in batches, openai even went through the effort to publish a k8s library for the task[2] of autoscaling clusters to minimize cost and manage it. [1]https://aws.amazon.com/ec2/spot/instance-advisor/ https://aws.amazon.com/ec2/spot/instance-advisor/ [2]https://github.com/openai/kubernetes-ec2-autoscaler https://github.com/openai/kubernetes-ec2-autoscaler

taeric 9y ago
Thanks! I meant more if you had numbers on how you managed your workflow to be able to take advantage of this pricing. I'm assuming there is no magic "this is the cheaper option" for most folks. Instead, you have to have a pipeline built up that can take advantage of this style of pricing. It is ironic that sometimes those pipelines are themselves cheaper to build up than building on fixed cost alternatives. But I don't think it is a given. (I would be surprised, but not shocked, to find I am wrong on that.)