3 ms·
If you value speed over storage, you can just replicate all the tables you need to join to every node, do a join on a subset on each node, then merge. It would
by nine_k 6y ago
If you value speed over storage, you can just replicate all the tables you need to join to every node, do a join on a subset on each node, then merge. It would improve latency quite a lot.
The problem arises when you can't fit an entire table on a single node, no matter how big your SAN is. But this would be really big data, few companies face this problem.
- DaiPlusPlus 6y agoIf you’re using a SAN, then surely every server node has at least read-only access to every table? The only thing they’d missing is in-memory indexes and cached execution-plans.
- nine_k 6y agoWithin the same datacenter, quite likely. Across datacenters, I'm not so sure.
- Retric 6y agoIt’s not just a problem of dataset sizes. You now need to send every update to every DB server. For something like an open world MMO it’s easy to start hitting billions of updates per second. Databases have hard trade offs and you need to make compromises somewhere.