3 ms·
I misread your first line as "here's the catch." :). I feel like your second paragraph delivered on my misreading. Do you have any numbers on that take? Or j
by taeric 9y ago
I misread your first line as "here's the catch." :). I feel like your second paragraph delivered on my misreading.
Do you have any numbers on that take? Or just a general feel that it works out?
- drenvuk 9y agoHere are your numbers for spot instance pricing[1]. Machine learning stuff will typically happen in batches, openai even went through the effort to publish a k8s library for the task[2] of autoscaling clusters to minimize cost and manage it. [1]https://aws.amazon.com/ec2/spot/instance-advisor/ https://aws.amazon.com/ec2/spot/instance-advisor/ [2]https://github.com/openai/kubernetes-ec2-autoscaler https://github.com/openai/kubernetes-ec2-autoscaler
- taeric 9y agoThanks! I meant more if you had numbers on how you managed your workflow to be able to take advantage of this pricing. I'm assuming there is no magic "this is the cheaper option" for most folks. Instead, you have to have a pipeline built up that can take advantage of this style of pricing. It is ironic that sometimes those pipelines are themselves cheaper to build up than building on fixed cost alternatives. But I don't think it is a given. (I would be surprised, but not shocked, to find I am wrong on that.)
- OkGoDoIt 9y agoThe specific projects I’m working on basically process data from an SQS queue. I have a bunch of spot instances set to launch at the minimum prices. If the prices jump (which they very rarely do) I simply have less throughput until the prices come back down. I also have a t2 instance as the web frontend. I’m significantly more budget constrained than I am time constrained, these are basically side projects. For specific numbers, the AllThePeople.net web scraping and profile compilation runs on Windows m1.small instances. The normal price is 8 cents per hour each while the spot instance costs me only a couple cents per hour each. I set the majority of my spot requests to the minimum possible price. I leave a couple at a higher price point of 8 cents per hour, so at least I have some work getting done if the prices go up. Those numbers are mostly for memory, it’s been a while since I fiddled with it much.