3 ms·
An old discussion arose about the need for backups. We had backups for most databases but no process was implemented for ElasticSearch databases. Also, that dat
by Johnny555 4y ago
An old discussion arose about the need for backups. We had backups for most databases but no process was implemented for ElasticSearch databases. Also, that database was a read model and by definition, it wasn’t the source of truth for anything. In theory, read models shouldn’t have backups, they should be rebuilt fast enough that won’t cause any or minimal impact in case of a major incident. Since read models usually have information inferred from somewhere else, It is debatable if they compensate for the associated monetary cost of maintaining regular backups
My biggest concern about restoring that Elasticsearch backup would be that the restored backup would be inconsistent with the real source of truth and it might be hard to reconcile to bring it up to date.
- antisthenes 4y agoThe backup only needs to last long enough until the production database is rebuilt from the source of truth, and then swapped back to the most recent search database. In other words, it only has to be good enough for a few days (ideally - hours).
- soco 4y agoWhile everything there is true, why not having a backup anyway? I have Elasticsearch backups and even used it once (with success) when I terraformed the index away. The delta was sourced then on the fly.
- CoolCold 4y agoI still don't have backups, any hint on proven method? I admit being lazy, but not so far couldn't imagine how to make consistent backup across the cluster, something similar to --single-transaction in mysql..
- nijave 4y agoSnapshot API https://www.elastic.co/guide/en/elasticsearch/reference/current/snapshot-restore.html https://www.elastic.co/guide/en/elasticsearch/reference/curr...
- deleted 4y ago[deleted]
- nijave 4y agoThey already had a reconcile process. They ended up running it against an old schema from a couple days ago but it sounds like they probably could have ran it against a backup (that was more recent) as well.