3 ms·

There is a simple trick to manage hash based partition growth Don't assign small number of tokens, but a much larger one If you have a million tokens, there i

by ayende 3y ago

There is a simple trick to manage hash based partition growth Don't assign small number of tokens, but a much larger one If you have a million tokens, there is no need to re-shard, and you can re assign tokens to different nodes as your cluster grows

dangoodmanUT 3y ago
There is overhead to a token. If that was the "simple trick", then why don't hash based systems like Cassandra, Scylla, Temporal, etc do that by default? Only somewhat effective if you start at massive scale tbh, and it still doesnt' solve hot partitions because it can be hot because of a single tenant (e.g. company ID) that can't be split across hash tokens, but can be across ranges