4 ms·
Atlassian comes clean on what data-deleting script behind outage did
- ars 5y agoDirect link to discussion of source https://news.ycombinator.com/item?id=31010501 https://news.ycombinator.com/item?id=31010501
- axiosgunnar 5y ago> The good news is that there are backups, and Atlassian retains them for 30 days. The bad news is that while the company can restore all customers into a new environment or roll back individual customers that accidentally delete their own data, there is no automated system to restore "a large subset" of customers into an existing environment, meaning data has to be laboriously pieced together. I never understood this. Then why just not restore the entire server and let the „smaller subset“ of previously unaffected customers eat crap? The whole story would have been „sorry for some reason we had to reset to our backups from yesterday, newer data was lost“, and at the outage would be over in <6h.
- goodside 5y ago“A large subset” doesn’t mean “the majority”. Presumably rolling back everyone would have been worse for Atlassian.
- mc4ndr3 5y agoSome manager: We need this done yesterday. Engineers: It's not fully tested-- Manager: Yesterday. Manager: And make sure to stick to the script!