3 ms·
I'm wondering if this refers to "virtual" nodes which are not coupled with physical nodes.
by j_kao 4y ago
I'm wondering if this refers to "virtual" nodes which are not coupled with physical nodes.
- ninth_ant 4y agoI believe this is the case, with many smaller nodes per physical host. I’ve seen this type of design pattern implemented successfully with a variety of extremely large databases.
- j_kao 4y agoYeah, I could see that even outside of the context of the Cassandra virtual nodes primitives. These could be K8s nodes for example, that don't make full utilization of the underlying VM, which would completely make sense at APPL scale. For some background to other HN users out there, "virtual" nodes refer to logical nodes in distributed database software where # of virtual nodes >= physical nodes. This means if the size of data passes a certain threshold, physical nodes can redistribute the virtual nodes, reducing the amount of data shuffled across physical nodes (as opposed to a naive hash function that mods a key by a fixed number and requires all nodes to reshuffle data when a new node is added).