3 ms·

Here is an Uber engineer's talk about their worst outage ever. 16 hours of downtime for their API as they repeatedly try and fail to promote a new postgresql ma

by sciurus 10y ago

Here is an Uber engineer's talk about their worst outage ever. 16 hours of downtime for their API as they repeatedly try and fail to promote a new postgresql master and reparent slaves to it. https://www.youtube.com/watch?v=bNeZYVIfskc&t=26m54s https://www.youtube.com/watch?v=bNeZYVIfskc&t=26m54s https://surge.omniti.com/2015/images/presentations/MattRanney_Surge.pdf https://surge.omniti.com/2015/images/presentations/MattRanne... (Slides 39-63)

merb 10y ago
the problem mostly happened cause ppl just ignored the "running out of disk space" message. Would happen on mysql, too. And I really wouldn't want that to happen on galera, I guess that would be a way bigger desaster.
- matwood 10y ago
  Running out of disk space on any RDBMS is a bad day.