12 ms·
I'm curious about how well the all-to-all communication strategy scales as clusters grow large. Just going off of this slide, the number of links and amount of
by jbl 16y ago
I'm curious about how well the all-to-all communication strategy scales as clusters grow large. Just going off of this slide, the number of links and amount of communication grows pretty fast as nodes are added.
Nodes could get inundated with management data... OTOH, maybe there's enough computing resources in a modern physical box to deal with this, particularly if you run a dedicated network for inter-node communication.
- thomasmeeks 16y agoI remember some enterprise java cache systems running into problems with an all-to-all communication model. It is a problem you can solve with hardware (second network as you mentioned), but can be a limiting factor for sure. 4,096 nodes means 8,386,560 connections between them, and the associated bandwidth caused by the nodes checking up on each other.
- simonw 16y agoI don't think Redis cluster quite works like that - it's a gossip system, so each Node only needs to talk to a few other nodes directly to get information about a much larger number of Nodes.