4 ms·
There's something reassuring in this for me. There's a lot of magic & handwaving from hyperscalers like AWS about redundancy. I always wondered about some of
by steveBK123 18d ago
There's something reassuring in this for me.
There's a lot of magic & handwaving from hyperscalers like AWS about redundancy. I always wondered about some of the engineering to make this absolutely (and literally) bullet proof. At the end of the day most of their answers when you push hard enough involved paying 2-3x to run everything across multiple zones/regions, and lots of awareness in your application to handle this.
In any case, I think it's good that when a data center blows up the data is lost. Noteworthy for future skynet situation, etc.
- antonvs 18d ago> I think it's good that when a data center blows up the data is lost. Noteworthy for future skynet situation, etc. Doesn’t really apply, because the only reason data was lost is because customers chose not to replicate it to other regions, either because of legal data residency requirements, cost, or just not bothering. If Skynet wants to make sure it’s backed up, none of that prevents it from doing so. Although it would be amusing if Skynet was stopped by a billing alert when it tries to copy itself to another region.
- htrp 18d agoaws egress fees: the real hero we didn't know we needed
- mitxela 18d agoAWS promises to keep data safe without requiring cross region redundancy. If you choose not to trust them that's valid but then why use them at all?
- Betelbuddy 18d ago>> AWS promises to keep data safe without requiring cross region redundancy. A perfect example of a claim they never made.
- mitxela 18d agoS3 is advertised as having 11 9's. That means in the entire history of S3 they've only lost a handful of objects, and will continue to lose objects at this same rate.
- Betelbuddy 18d agoYou are confusing the concepts, and applying the 11 nines to the wrong problem. Durability is about: "If I successfully store an object in S3, how unlikely is S3 to permanently lose that object because of storage failures?" It does not answer: "Will I be able to access that object, after a rain of Shahab-1 or Shahab-2 burn all data centers in the 3 availability regions across which my S3 bucket is spread out..."
- mitxela 17d agoIs a disk being hit by a missile not a disk failure? Someone should inform the RAID controller those disks are actually fine, then.
- antonvs 18d agoEleven nines covers ordinary infrastructure failures, not acts of war that physically destroy the underlying facilities. It's similar to any engineered artifact, like a skyscraper. They have a structural safety factor that defines their resilience to failures that the system is designed to tolerate, it doesn't make them immune to missile strikes.
- mitxela 17d agoThis is a normal failure mode in American military facilities in the Middle East. Whoever designed an American military facility in the middle east and did not intend for it to withstand missile attacks was incompetent.
- antonvs 17d agoYou think you can cover up your misunderstanding of how data durability numbers work with zealotry?
- amelius 18d agoThey should have asked AI to implement the redundancy.
- marginalia_nu 18d ago[dead]
- paulddraper 18d agoHow would have that changed anything?
- steveBK123 18d agoFirst of all they could write an amazing slop blog PR post about it afterwards
- amelius 18d agoIf you still think AI produces slop then you aren't paying enough for your AI.
- steveBK123 18d agoSlop blog
- antonvs 17d agoThere’s a provider that’s more expensive than Anthropic?
- cmiles8 18d agoAWS has a history of making hand wavy explanations on the robustness of its infrastructure that were misleading at best. See comments about how regions are truly independent only for everyone to find out if us-east-1 goes down you could still be down even if you built in other regions. Those dependencies were not well documented and previously hand-waved away by AWS when it boasted about how its regions were truly independent. Similar here, there’s a lot of detail that got hand-waved away by a sloppy “yeah we good” puff PR answer.
- steveBK123 18d agoI suspect at this point, given the nature of the AWS org.. they actually don't even know themselves either.