4 ms·

Is there tooling to find the global minimum price for an instance with certain characteristics? I found it easy enough to do that in one region, but I've got s

Is there tooling to find the global minimum price for an instance with certain characteristics? I found it easy enough to do that in one region, but I've got some compute workloads that just read/write from S3 and are not latency sensitive. They do need 128 GB RAM and ephemeral disks.

DJBunnies 4y ago
> compute workloads that just read/write from S3 > need 128 GB RAM Eh?
- tyingq 4y ago
  I took "just read/write from S3" to mean that they didn't interact with any other AWS services apart from S3. Such that they didn't care where in the world it ran. Not that they didn't do anything memory intensive.
  - socialismisok 4y ago
    You got it. It's some drone image processing. Read in data from S3, do analysis, write results.
ericpauley 4y ago
Spot fleet requests allow you to set minimum specs for instances, and the fleet will be composed of any instances that meet the spec. If it's asynchronous work, you could pick lowest price allocation and not worry too much about interruptions. In fact, if your work is tolerant of interruptions (batch size <2min), you can actually save even more by being interrupted, as you don't get billed for partial hours: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/billing-for-interrupted-spot-instances.html https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/billing-...
- socialismisok 4y ago
  Does it launch the fleet at the global minimum price? "Any instances that meet the spec" doesn't seem like it's a worldwide price minimum.
  - ericpauley 4y ago
    You can set this to emphasize diversity or price when creating the request.
    - socialismisok 4y ago
      Across all regions? Everything I've seen is only for one region.
      - ericpauley 4y ago
        Correct, though generally you’d have region constraints on your workload. We do see a lot of value in going cross-region for expensive tasks that aren’t latency or data transfer sensitive, such as running machine learning model training in cheaper regions.

DJBunnies 4y ago

> compute workloads that just read/write from S3 > need 128 GB RAM Eh?

tyingq 4y ago
I took "just read/write from S3" to mean that they didn't interact with any other AWS services apart from S3. Such that they didn't care where in the world it ran. Not that they didn't do anything memory intensive.
- socialismisok 4y ago
  You got it. It's some drone image processing. Read in data from S3, do analysis, write results.

ericpauley 4y ago

Spot fleet requests allow you to set minimum specs for instances, and the fleet will be composed of any instances that meet the spec. If it's asynchronous work, you could pick lowest price allocation and not worry too much about interruptions. In fact, if your work is tolerant of interruptions (batch size <2min), you can actually save even more by being interrupted, as you don't get billed for partial hours: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/billing-for-interrupted-spot-instances.html https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/billing-...

socialismisok 4y ago
Does it launch the fleet at the global minimum price? "Any instances that meet the spec" doesn't seem like it's a worldwide price minimum.
- ericpauley 4y ago
  You can set this to emphasize diversity or price when creating the request.
  - socialismisok 4y ago
    Across all regions? Everything I've seen is only for one region.
    - ericpauley 4y ago
      Correct, though generally you’d have region constraints on your workload. We do see a lot of value in going cross-region for expensive tasks that aren’t latency or data transfer sensitive, such as running machine learning model training in cheaper regions.