3 ms·
Re: Onyx's architecture. I would wonder about performance when keeping a shared log in ZooKeeper. Why not use something like Kafka -- it is designed for high-vo
by dj-wonk 12y ago
Re: Onyx's architecture. I would wonder about performance when keeping a shared log in ZooKeeper. Why not use something like Kafka -- it is designed for high-volume, immutable logging. ZK works best for less-frequently changing configuration, such as node connection information or snapshotting. I could be wrong. I'd like to hear your thoughts and experience.
- XPherior 12y ago- Picking up Kafka means introducing another dependency. - Onyx's log doesn't grow particularly large because it's only used for coordination, not for messaging. - Because the log isn't huge, and can be GC'ed, consumers don't experience high volumes of messages. - ZooKeeper offers sequential node creation - making it a really good fit for what the log needs to do.