4 ms·
Sounds more like some pants browning because incidents like this are a great reason to just use aws. Like come on: > After the end of the system-assigned 1 ye
by x0x0 2y ago
Sounds more like some pants browning because incidents like this are a great reason to just use aws. Like come on:
> After the end of the system-assigned 1 year period, the customer’s GCVE Private Cloud was deleted. No customer notification was sent because the deletion was triggered as a result of a parameter being left blank by Google operators using the internal tool, and not due a customer deletion request. Any customer-initiated deletion would have been preceded by a notification to the customer.
... Tada! We're so incompetent we let giant deletes happen with no human review. Thank god this customer didn't trust us and kept off-gcp backups or they'd be completely screwed.
> There has not been an incident of this nature within Google Cloud prior to this instance. It is not a systemic issue.
Translated to English: oh god, every aws and Azure salesperson has sent 3 emails to all their prospects citing our utter fuckup.
- markfive 2y ago> Thank god this customer didn't trust us and kept off-gcp backups or they'd be completely screwed. Except that, from the article, the customer's backups that were used to recover were in GCP, and in the same region.
- ceejayoz 2y agoI'm curious about that bit. https://www.unisuper.com.au/contact-us/outage-update https://www.unisuper.com.au/contact-us/outage-update says "UniSuper had backups in place with an additional service provider. These backups have minimised data loss, and significantly improved the ability of UniSuper and Google Cloud to complete the restoration."
- politelemon 2y agoThat's the bit that's sticking out to be as contradictory. I'm inclined to not believe what GCP have said here as an account deletion is an account deletion, why would some objects be left behind. No doubt this little bit must be causing some annoyance among UniSuper's tech teams.
- flaminHotSpeedo 2y agoI'm inclined to not believe GCP because they edited their status updates retroactively and lied in their postmortem about the Clichy fire in Paris not affecting multiple "zones"
- graemep 2y agoThe had another provider because the regulator requires it. I suspect a lot of businesses in less regulated industries do not.
- skywhopper 2y agoI think you misread. Here’s the relevant statement from the article: “Data backups that were stored in Google Cloud Storage in the same region were not impacted by the deletion, and, along with third party backup software, were instrumental in aiding the rapid restoration.”