3 ms·
Just curious... At what scale have you run Cassandra? We're running a cluster containing around 50 TB of data and we see massive issues around compaction and re
by haggy 9y ago
Just curious... At what scale have you run Cassandra? We're running a cluster containing around 50 TB of data and we see massive issues around compaction and repair. While I agree Cassandra is impressive, it definitely comes with a lot of management overhead.
- andy_ppp 9y agoYes, I've just played around with it, even if what I built was fairly complex and well tested. I assume you are running with a lot of extra servers - you need extra capacity for the operations you suggest (they move data around right) that might amount to a constant 20% over provisioning from normal use at the times these operations run, obviously also adding and removing servers adds overhead too. It's not like a normal database with provisioning at all. I'd actually like a mode where Cassandra made itself artificially slower forcing you to over provision and then removed said slowness during operations that need the extra performance.
- late2part 9y agoI help run clusters about 100 times this size. Things work remarkably wonderful. Huge database systems require investment in setup and operation. What is causing problems that need repair? How much spare space do you keep per node for compactions? What is your spec on a per Node basis?