6 ms·

> How much would it cost to move this across boxes in EC2? Nothing. You generally only pay for data going out of cloud providers. Not data going in or data bei

> How much would it cost to move this across boxes in EC2? Nothing. You generally only pay for data going out of cloud providers. Not data going in or data being transferred within the same region. > One obvious example is that EC2 has "scheduled maintenance events" where they force you to reboot your box. This would cost us a lot of money (mostly in dev time, to work around it). You're not going to have a successful cloud experience unless you build your applications in a cloud suitable way. This means not all legacy applications are a good fit for the public cloud. Most companies really embracing the cloud are mitigating those risks by distributing workloads across multiple instances so you don't care if any one needs to be restarted, especially within a planned window. > Also, multi-second network dropouts in big cloud datacenters are not uncommon (in my limited experience), but that would be really bad for us. We have millisecond-scale failover with 2x or 3x redundancy on important systems. Are these inter-region network dropouts or between the internet and the cloud data center? You're not going to be relying on a public internet connection to the cloud for critical workloads. All that being said, there are plenty of workloads which I don't think fit well in the cloud operating model. You may very well have one of them.

iampims 7y ago
You pay for cross-AZ Traffic in AWS, and that adds up really fast.
- tstrimple 7y ago
  Yes. You've got to be aware of where those boundaries are when adopting the cloud and the cost information around these cases are inadequate at best. Too many people get surprise bills.
  - hinkley 7y ago
    The first step is to stop blaming the victim. It's nobody's fault that the billing structure at Amazon is so complicated and confusing. Except Amazon's.
- Wintereise 7y ago
  Yep. Got bitten HARD by this recently, $1.5k inter-az transfer charges that we never saw coming. Our fault, I suppose -- but multi-az is prohibitively expensive if you need to run anything data heavy distributed.
  - resonator 7y ago
    I'm working on reducing a $50K per month bill for Inter-AZ traffic at the moment. > but multi-az is prohibitively expensive if you need to run anything data heavy distributed. If you communicate between your AZs via ALBs, multi-az is effectively free. Our bill is so high because within our Kubernetes cluster, our mesh isn't locality aware; it randomly routes to any available pod. 2/3rds of our traffic crosses AZs.
centimeter 7y ago
> unless you build your applications in a cloud suitable way Right, we have not done this. We basically decided it was cheaper to keep doing the “old school” thing and not spend a bunch of dev time trying to do it in a way that supports arbitrary failure of N boxes. We just spent the money to make it unlikely our boxes or networks will fail, and if they do fail we may be sad (but it rarely happens, and has not yet happened in a catastrophic way). > Are these inter-region network dropouts or between the internet and the cloud data center? I’ve seen multi-second dropouts within a DC (cloud, not my current company), and multi-hour single-path failures between DCs (usually something like a fire or construction cutting a line). But all of our DCs have at least 2 physically independent routes to the internet, so it’s never taken us fully offline.
takeda 7y ago
> Nothing. You generally only pay for data going out of cloud providers. Not data going in or data being transferred within the same region. This is not true, AWS charges for all traffic cross AZ, so if you want a resilience within a region (which you mentioned in next paragraph) you will do a lot of that talking and this ends up a non trivial cost. You can do some optimization though by having your apps being aware of AZs they are on, but most places don't do that, more common are places that run everything from a single AZ.

iampims 7y ago

You pay for cross-AZ Traffic in AWS, and that adds up really fast.

tstrimple 7y ago
Yes. You've got to be aware of where those boundaries are when adopting the cloud and the cost information around these cases are inadequate at best. Too many people get surprise bills.
- hinkley 7y ago
  The first step is to stop blaming the victim. It's nobody's fault that the billing structure at Amazon is so complicated and confusing. Except Amazon's.
Wintereise 7y ago
Yep. Got bitten HARD by this recently, $1.5k inter-az transfer charges that we never saw coming. Our fault, I suppose -- but multi-az is prohibitively expensive if you need to run anything data heavy distributed.
- resonator 7y ago
  I'm working on reducing a $50K per month bill for Inter-AZ traffic at the moment. > but multi-az is prohibitively expensive if you need to run anything data heavy distributed. If you communicate between your AZs via ALBs, multi-az is effectively free. Our bill is so high because within our Kubernetes cluster, our mesh isn't locality aware; it randomly routes to any available pod. 2/3rds of our traffic crosses AZs.

centimeter 7y ago

> unless you build your applications in a cloud suitable way Right, we have not done this. We basically decided it was cheaper to keep doing the “old school” thing and not spend a bunch of dev time trying to do it in a way that supports arbitrary failure of N boxes. We just spent the money to make it unlikely our boxes or networks will fail, and if they do fail we may be sad (but it rarely happens, and has not yet happened in a catastrophic way). > Are these inter-region network dropouts or between the internet and the cloud data center? I’ve seen multi-second dropouts within a DC (cloud, not my current company), and multi-hour single-path failures between DCs (usually something like a fire or construction cutting a line). But all of our DCs have at least 2 physically independent routes to the internet, so it’s never taken us fully offline.

takeda 7y ago

> Nothing. You generally only pay for data going out of cloud providers. Not data going in or data being transferred within the same region. This is not true, AWS charges for all traffic cross AZ, so if you want a resilience within a region (which you mentioned in next paragraph) you will do a lot of that talking and this ends up a non trivial cost. You can do some optimization though by having your apps being aware of AZs they are on, but most places don't do that, more common are places that run everything from a single AZ.