4 ms·

it's important to inform customers about the resiliency of their systems and let them pick how far they are going to invest for it. then you get to eat popcorn

it's important to inform customers about the resiliency of their systems and let them pick how far they are going to invest for it. then you get to eat popcorn when stuff explodes. * single server event. $ * multi server event. $$ * single az event. $$$ * multi az event. $$$$ * global provider event. $$$$$ * cross provider event. $$$$$$ * alien invasion. $$$$$$$$$$$$$$

xyst 3y ago
Just need to deploy your service on Mars AND Earth. Duh
- dmckeon 3y ago
  And you thought the current time zone confusion was bad. Now you have two sets of time zones, and a varying delay of about 5 to 21 minutes between them. Oh, the joy!
  - kobalsky 3y ago
    note to self: synchronous replication may be a problem
- elzbardico 3y ago
  Multi-planetary-AZ DB cluster deployments. Putting the emphasis on "Eventual" in eventual consistency. Go for a walk before retrying reading from this replica!
matwood 3y ago
Back when we had servers in an onsite DC we lost a raid card and the system I was developing went down. We had the fancy support so a tech was out with the card replaced in a couple hours, then we had to restore from tape backup. All in all, a non-critical system was down for most of a business day. My bosses boss stormed in, upset he couldn't pull a report, and asked how do we prevent this in the future. I responded at a minimum we had to double the cost for a hot standby, and he said 'never mind' and walked out.
- d8dUf7KjBEYCk7Q 3y ago
  That sounds nice. My boss's boss is usually the one storming in, and he usually says "okay let's do it", and then I have to implement it in a week...
  - bombcar 3y ago
    That’s why you always BofH the estimates to include some fun toys for yourself, too
    - respite 3y ago
      [flagged]
Endy 3y ago
Always be prepared for alien invasion
bell-cot 3y ago
"Briefly describe the '$$$$$$$' through '$$$$$$$$$$$$$' situations. Can't leave money lying on the table." - memo from Enterprise Sales Dept.
- mjevans 3y ago
  Alien invasion resistant is spy novel / agents of shield level of multiple, redundant, isolated, off the normal books, safehouses + bases. Short of alien invasion level are strategic military resistance levels to global/regional wars with differing levels of weapons and devastation.
underbluewaters 3y ago
This should be logarithmic
- svieira 3y ago
  The nice thing is that any graph without a unit can be log-scale - so in a way, it already is.

xyst 3y ago

Just need to deploy your service on Mars AND Earth. Duh

dmckeon 3y ago
And you thought the current time zone confusion was bad. Now you have two sets of time zones, and a varying delay of about 5 to 21 minutes between them. Oh, the joy!
- kobalsky 3y ago
  note to self: synchronous replication may be a problem
elzbardico 3y ago
Multi-planetary-AZ DB cluster deployments. Putting the emphasis on "Eventual" in eventual consistency. Go for a walk before retrying reading from this replica!

matwood 3y ago

Back when we had servers in an onsite DC we lost a raid card and the system I was developing went down. We had the fancy support so a tech was out with the card replaced in a couple hours, then we had to restore from tape backup. All in all, a non-critical system was down for most of a business day. My bosses boss stormed in, upset he couldn't pull a report, and asked how do we prevent this in the future. I responded at a minimum we had to double the cost for a hot standby, and he said 'never mind' and walked out.

d8dUf7KjBEYCk7Q 3y ago
That sounds nice. My boss's boss is usually the one storming in, and he usually says "okay let's do it", and then I have to implement it in a week...
- bombcar 3y ago
  That’s why you always BofH the estimates to include some fun toys for yourself, too
  - respite 3y ago
    [flagged]

Endy 3y ago

Always be prepared for alien invasion

bell-cot 3y ago

"Briefly describe the '$$$$$$$' through '$$$$$$$$$$$$$' situations. Can't leave money lying on the table." - memo from Enterprise Sales Dept.

mjevans 3y ago
Alien invasion resistant is spy novel / agents of shield level of multiple, redundant, isolated, off the normal books, safehouses + bases. Short of alien invasion level are strategic military resistance levels to global/regional wars with differing levels of weapons and devastation.

underbluewaters 3y ago

This should be logarithmic

svieira 3y ago
The nice thing is that any graph without a unit can be log-scale - so in a way, it already is.