3 ms·
"With me so far? Neither am I." Ok, look, I know CAP and distributed databases are hard, but this article is presumably about to go into some deep wading, and
by AtlasBarfed 5y ago
"With me so far? Neither am I."
Ok, look, I know CAP and distributed databases are hard, but this article is presumably about to go into some deep wading, and it basically does the Barbie "Math is Hard"? Come on.
"Consul is designed to make it easy to manage a single engineering team's applications. We're managing deployments for thousands of teams. It's led us to a somewhat dysfunctional relationship."
Um, I don't know consul's gotchas because I am a Cassandra guy, and a demi-Dynamo guy. Yes yes, I know any problem that is attempted to be solved by cassandra fits the joke "well, now you have two problems". But it does scale.
Why is raft needed for a simple quorum write for a key-value <service name> = <ip> ?
Thousands of teams does not sound like a hard database scaling problem. How often is this read? How often is this written?
- tptacek 5y agoIt's thousands of teams with consistency around the entire world, updated and read in real time as the control plane of a CDN. I didn't go into detail about Raft because it isn't the point of the article, and because I don't want people checking out because they feel like they need to grok distributed consensus to understand what we're saying. If that means we lose people with strong opinions about Raft, I'll accept the tradeoff.
- _vvhw 5y agoMakes sense about not wanting to go boating. I've been deep into distributed consensus the past year—working on a 1 million TPS replicated state machine called TigerBeetle [1]. I would have enjoyed even more detail, only to understand the problem better, but I loved this line: "With me so far? Neither am I." [1] https://github.com/coilhq/tigerbeetle https://github.com/coilhq/tigerbeetle