4 ms·
It's curious that all of the incidents are database related.
by vb-8448 3y ago
It's curious that all of the incidents are database related.
- grepfru_it 3y agoNo, well kinda. I think it's related to how github chunks data on the backend. That chunking methodology does depend on the database. They mention it worked elsewhere in the org, which makes me wonder if it was a fix to support their managed hosts.
- fwlr 3y agoOne thought: GitHub is basically a bunch of very complicated interconnected databases, no? I mean, to some extent all large web companies are, but GitHub much more than most. Any failure is going to be, in some sense, a database failure. Another thought: this could speak to a critical weakness in GitHub’s database team. Maybe they hired a lot of bad developers to the database team at the same time, maybe a bad culture took root in the database wing’s management team.
- vb-8448 3y agoLooking at the issue details, I'll guess they have "poor ops practices": - 9th may: during a deployment, rollback didn't work - 10th may: a recently deployed function killed the database - 11th may: failover didn't work
- aaomidi 3y agoDatabases are legitimately the worst part of every company. All the new, and much better tech is so fucking expensive. CockroachDB has the worst sales people that can’t even demonstrate their own benchmarks. Spanner is just unaffordable for most. Postgres/MySQL are great but making them scale for write heavy workloads is a pain. I also hate managing primary/failover systems. We have consensus algorithms now. Let’s just use them.