4 ms·

> Generally speaking, you should have accounted for this situation ahead of time in your engineering plans. I believe this comes as a shock to most people the

> Generally speaking, you should have accounted for this situation ahead of time in your engineering plans. I believe this comes as a shock to most people the first time they receive this email, it was to us at least. When we signed up with amazon there was no guideline or advice saying "hey in a year or 2 your hardware might fail or need replaced, have a migration plan ready" Perhaps it was our naivety, but we just thought hey, its the cloud, what could go wrong?! Now of course are are battle hardened

michaelmior 13y ago
More accurately: "Your hardware my fail at any time."
- rch 13y ago
  I had an instance fail (unresponsive then with that same stop/start delay) on the same day in two consecutive years. I remember because it happened to be Valentine's Day, and I had to break out the laptop for while to check on things. I always wondered if that was a completely random occurrence, or part of some maintenance schedule that randomly affected me twice. The last place I worked has a policy of making zero changes in production Friday-Sunday or around holidays. It was one of their better practices.
m_ram 13y ago
FWIW, they have a brief section about hardware failure in the Getting Started Guide [1]. I don't know how long it's been there. [1] http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-console.html http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-... (bottom of the page)
cmelbye 13y ago
I honestly thought most people knew that about EC2 as one of the core "trade offs" or engineering decision that allows the platform to be what it is, compared to a more traditional VPS provider.
- saurik 13y ago
  That isn't a tradeoff of EC2: hardware fails... I've had servers from actual unmanaged server providers have random failures and need maintenance or need to be replaced as well. Hell: I've had my hosting provider tell me they are moving data centers before ;P. The real problem here is just that Amazon has made the idea of putting your servers in the cloud so easy that people who don't understand that the servers don't run on evil magic are able to use them.
vidarh 13y ago
EC2 used to terminate instances with no warning in many situations when it launched. It seems they've concluded most people didn't understand that, and avoid that whenever possible now. But "cloud" compute services should in general be treated as less reliable per individual unit unless your provider explicitly explain to you why not (such as guaranteeing to use a high-availability distributed filesystem), as you no direct way of ascertaining status of the underlying hardware. You need to plan for failure regardless.

michaelmior 13y ago

More accurately: "Your hardware my fail at any time."

rch 13y ago
I had an instance fail (unresponsive then with that same stop/start delay) on the same day in two consecutive years. I remember because it happened to be Valentine's Day, and I had to break out the laptop for while to check on things. I always wondered if that was a completely random occurrence, or part of some maintenance schedule that randomly affected me twice. The last place I worked has a policy of making zero changes in production Friday-Sunday or around holidays. It was one of their better practices.

m_ram 13y ago

FWIW, they have a brief section about hardware failure in the Getting Started Guide [1]. I don't know how long it's been there. [1] http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-console.html http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-... (bottom of the page)

cmelbye 13y ago

I honestly thought most people knew that about EC2 as one of the core "trade offs" or engineering decision that allows the platform to be what it is, compared to a more traditional VPS provider.

saurik 13y ago
That isn't a tradeoff of EC2: hardware fails... I've had servers from actual unmanaged server providers have random failures and need maintenance or need to be replaced as well. Hell: I've had my hosting provider tell me they are moving data centers before ;P. The real problem here is just that Amazon has made the idea of putting your servers in the cloud so easy that people who don't understand that the servers don't run on evil magic are able to use them.

vidarh 13y ago

EC2 used to terminate instances with no warning in many situations when it launched. It seems they've concluded most people didn't understand that, and avoid that whenever possible now. But "cloud" compute services should in general be treated as less reliable per individual unit unless your provider explicitly explain to you why not (such as guaranteeing to use a high-availability distributed filesystem), as you no direct way of ascertaining status of the underlying hardware. You need to plan for failure regardless.