3 ms·
I noticed that we weren't validating backups at a company I used to work at so I did a /really/ simple hack where I checked that the backups were within a certa
by wlll 3y ago
I noticed that we weren't validating backups at a company I used to work at so I did a /really/ simple hack where I checked that the backups were within a certain number of bytes in size of the previous dump.
Literally a couple of weeks later after putting this live (I think it was a Nagios check) it alerted that the backups had gone down from many 10s of GB to a few k in size. I can't remember what had gone wrong now, it was years ago, but we /did/ catch the issue.
Obviously this isn't a comprehensive check, I later wrote a tool that pulled backups down, restored them, and did some sanity checks on the data, but the quick hack worked as an interim.
- hnarn 3y agoWhile you have reason to be proud about setting up the monitoring, your most unique and valuable skill in that moment was that you gave a shit.
- wlll 3y agoHonestly, thinking about how contracts have gone in the past, I think a fair amount of the value I provide is in giving a shit about stuff.