4 ms·

Facebook's Zookeeper Implementation on Delos

67 points by somerando7 4y ago

gardenfelder 4y ago
Where is the github repo?
- somerando7 4y ago
  It isn't open source
rdxm 4y ago
abusaidm 4y ago
anyone loose their history to go back after opening the article page? I had to double check I didn't open in external tab. browsing on firefox.
- kzemek 4y ago
  Firefox quarantines Facebook sites in a separate container (with its own cookies and browsing history, etc.), losing back button is an unfortunate side effect.
  - abusaidm 4y ago
    Thanks, I clearly forgot about this given how little I visit it.
deleted 4y ago
[deleted]
monstrado 4y ago
Curious when the folks at ClickHouse are going to decide to spin its custom rewrite of ZooKeeper in C++ (ClickHouse-Keeper [1]) out into its own separate project. [1] https://clickhouse.com/docs/en/operations/clickhouse-keeper/ https://clickhouse.com/docs/en/operations/clickhouse-keeper/
- hodgesrm 4y ago
  Funny, the committers were at an Amsterdam meetup last night and we were talking about ClickHouse Keeper. I don't think that's very high up the list of priorities for them right now. The focus is more on ensuring it is bombproof--we're in the "long tail" part of the deployment where you stamp out obscure edge cases in increasingly large deployments. (I'm not a committer but have a lively interest in the topic as my company supports a couple hundred customers running on ClickHouse.)
kbumsik 4y ago
Off-topic, but does Zookeeper have features that etcd doesn't provide? etcd seems to be simpler to operate at a glance.
- pram 4y ago
  Running ZK was pretty easy with Exhibitor (not that I’d recommend it over etcd) but it’s defunct now. Otherwise manually managing it is crufty and ancient feeling. The API for “dynamic reconfiguration” is like something I’d expect from Oracle software in the 90s. It sucks.
- maxmcd 4y ago
  My understanding is that they have different consistency models and different APIs. I think etcd might be better suited for more use-cases, but I don't think migration of existing systems is straightforward. Some previous discussion here: https://news.ycombinator.com/item?id=18687516 https://news.ycombinator.com/item?id=18687516 I also enjoyed this lecture about zookeeper: https://www.youtube.com/watch?v=pbmyrNjzdDk https://www.youtube.com/watch?v=pbmyrNjzdDk
- cogman10 4y ago
  Not much they have pretty compatible feature overlap. Zookeeper pushes pretty heavily on a smart client rather than handling a lot of stuff server side. If I were to pick I'd go with etcd in a heartbeat. Every con they list on their comparison website is stuff I've personally dealt with in ZK. https://etcd.io/docs/v3.3/learning/why/#zookeeper https://etcd.io/docs/v3.3/learning/why/#zookeeper
  - kbumsik 4y ago
    Actually I was asking the question looking at the etcd doc you linked. The etcd doc explains like it is just better than Zookeeper. Then why there are so many projects still rely on Zookeeper and spend so much time on re-writing its features instead of switching to etcd like what OP, ClickHouse (in the discussion), and Kafka (KRaft) are doing? It there something that etcd won't fit?
piskov 4y ago
- klysm 4y ago
  This one is especially bad. It's not hard to check your contrast to make sure it's up to snuff.
- deleted 4y ago
  [deleted]
- pvg 4y ago
  Please don't complain about tangential annoyances—things like article or website formats, name collisions, or back-button breakage. They're too common to be interesting. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html

67 points by somerando7 4y ago

gardenfelder 4y ago

Where is the github repo?

somerando7 4y ago
It isn't open source

rdxm 4y ago

abusaidm 4y ago

anyone loose their history to go back after opening the article page? I had to double check I didn't open in external tab. browsing on firefox.

kzemek 4y ago
Firefox quarantines Facebook sites in a separate container (with its own cookies and browsing history, etc.), losing back button is an unfortunate side effect.
- abusaidm 4y ago
  Thanks, I clearly forgot about this given how little I visit it.

deleted 4y ago

[deleted]

monstrado 4y ago

Curious when the folks at ClickHouse are going to decide to spin its custom rewrite of ZooKeeper in C++ (ClickHouse-Keeper [1]) out into its own separate project. [1] https://clickhouse.com/docs/en/operations/clickhouse-keeper/ https://clickhouse.com/docs/en/operations/clickhouse-keeper/

hodgesrm 4y ago
Funny, the committers were at an Amsterdam meetup last night and we were talking about ClickHouse Keeper. I don't think that's very high up the list of priorities for them right now. The focus is more on ensuring it is bombproof--we're in the "long tail" part of the deployment where you stamp out obscure edge cases in increasingly large deployments. (I'm not a committer but have a lively interest in the topic as my company supports a couple hundred customers running on ClickHouse.)

kbumsik 4y ago

Off-topic, but does Zookeeper have features that etcd doesn't provide? etcd seems to be simpler to operate at a glance.

pram 4y ago
Running ZK was pretty easy with Exhibitor (not that I’d recommend it over etcd) but it’s defunct now. Otherwise manually managing it is crufty and ancient feeling. The API for “dynamic reconfiguration” is like something I’d expect from Oracle software in the 90s. It sucks.
maxmcd 4y ago
My understanding is that they have different consistency models and different APIs. I think etcd might be better suited for more use-cases, but I don't think migration of existing systems is straightforward. Some previous discussion here: https://news.ycombinator.com/item?id=18687516 https://news.ycombinator.com/item?id=18687516 I also enjoyed this lecture about zookeeper: https://www.youtube.com/watch?v=pbmyrNjzdDk https://www.youtube.com/watch?v=pbmyrNjzdDk
cogman10 4y ago
Not much they have pretty compatible feature overlap. Zookeeper pushes pretty heavily on a smart client rather than handling a lot of stuff server side. If I were to pick I'd go with etcd in a heartbeat. Every con they list on their comparison website is stuff I've personally dealt with in ZK. https://etcd.io/docs/v3.3/learning/why/#zookeeper https://etcd.io/docs/v3.3/learning/why/#zookeeper
- kbumsik 4y ago
  Actually I was asking the question looking at the etcd doc you linked. The etcd doc explains like it is just better than Zookeeper. Then why there are so many projects still rely on Zookeeper and spend so much time on re-writing its features instead of switching to etcd like what OP, ClickHouse (in the discussion), and Kafka (KRaft) are doing? It there something that etcd won't fit?

piskov 4y ago

klysm 4y ago
This one is especially bad. It's not hard to check your contrast to make sure it's up to snuff.
deleted 4y ago
[deleted]
pvg 4y ago
Please don't complain about tangential annoyances—things like article or website formats, name collisions, or back-button breakage. They're too common to be interesting. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html