4 ms·
The whole thing is an incredible achievement - you have a new design, running on a new infrastructure, written in a new language. I'd be very interested in any
by technion 10y ago
The whole thing is an incredible achievement - you have a new design, running on a new infrastructure, written in a new language.
I'd be very interested in any information on how you provided yourselves confidence in the product? There are so many ways that a software issue could bring all that redundancy down.
- james_cowling 10y agoThis is a really great question since the vast majority of the work was in ensuring correctness and reliability: everything from testing discipline to fault injection to auditing. This also included hardware testing, like pulling out circuit breakers to test our power distribution, or overheating a rack to test graceful shutdown. I'll give a slightly lazy answer here however and point you to a talk I gave about building durable systems, which covers a lot of this material: https://www.oreilly.com/events/velocity/devops-web-performance-ny-2015/sessions/46120/durability-theater-or-real-world-safety-how-to-engineer-against-data-loss https://www.oreilly.com/events/velocity/devops-web-performan...