I can('t) imagine, yikes. Now I'm remembering the story of how, when a certain blue website fell off the Internet for a day ~a decade and a half ago (due to so

I can('t) imagine, yikes. Now I'm remembering the story of how, when a certain blue website fell off the Internet for a day ~a decade and a half ago (due to some slightly broken database migration logic), out-of-band access boiled down to who was still logged in (!): https://rachelbythebay.com/w/2019/01/20/quiet/ https://rachelbythebay.com/w/2019/01/20/quiet/ Amusingly when things went wrong again last year, it was BGP's fault (is this the hyperscale equivalent of "it's always DNS" or something?). Engineers (with adequate credentials) had to actually drive to the datacenter haha. I would be very interested to hear more about how the break-glass process worked.