5 ms·
All that infra doesn’t integrate itself. Everywhere I’ve worked that had this kind of stack employed at least one if not a team of DevOps people to maintain it
by davedx 3y ago
All that infra doesn’t integrate itself. Everywhere I’ve worked that had this kind of stack employed at least one if not a team of DevOps people to maintain it all, full time, the year round. Automating a database backup and testing it works takes half a day unless you’re doing something weird
- isbvhodnvemrwvn 3y agoSetting up a multi-az db with automatic failover, incremental backups and PiTR, automated runbooks and monitoring all that doesn't take half a day, not even with RDS.
- davedx 3y agoNo, but again, that sounds like a lot of complexity your average startup does not need. Multi-az? Why?
- marcinzm 3y agoBecause their Enterprise client requires it on their due diligence paperwork.
- dvfjsdhgfv 3y agoWhich makes little sense anyway as in practice the real problems you have are from region/connectivity issues, not AZ failures.
- fullstackchris 3y agoA startup sized company using this many tools? They're for sure doing something weird (and that's not a compliment :) ) Totally on your side with this one - but alas, people associate value with complexity.
- ffsm8 3y ago> Automating a database backup and testing it works takes half a day unless you’re doing something weird True story bro I'm sure that's possible if you're storing the backup on the same server you're restoring on and everything is on top of the line nvme storage. Otherwise your backup just started to run and will need another few days to finish. And that's only if you're running single master. You're massively underestimating the challenge to get that kind of automation done in a stable manner - and the maintenance required to keep it working over the years.
- davedx 3y agoI’ve implemented such a process for companies multiple times, bro. I know what I’m talking about.
- marcinzm 3y agoAnd that's the problem. "It's easy for me because I've done it a dozen times so it's easy for everyone" is a very common fallacy.
- layer8 3y agoWhat happened to having people trained by external trainers for what you need? That’s much cheaper than having everything externally “managed” and still having to integrate all of it. The number of services listed in TFA is just ridiculous.
- davedx 3y agoThis is an oversimplification, but! Dumping postgres to a file is one command. scp the file to a different server is two commands. (Granted you need to setup ssh keys there too). I have implemented backups this way. With sqlite you only need the scp part. You can even push your backup file to an S3 bucket... with one command! Honestly, this argument mystifies me. Of course you can make it as complicated as you want to, too. I've also worked on replicating anonymized data from a production OLTP database to a data warehouse. That's a lot more work.