3 ms·
Does CitusDb fit in olap analytical workloads to do aggregations on hundreds millions of records using varying order and size of dimensions (eg druid) in max of
by satygeek 11y ago
Does CitusDb fit in olap analytical workloads to do aggregations on hundreds millions of records using varying order and size of dimensions (eg druid) in max of 3 seconds response time using as few boxes as possible - Or there are other techniques have to be used along with Citusdb? Can you shed a light on your experience with CloudFlare in terms of cluster size and queries perf?
- lfittl 11y agoI'll leave the initial questions to the Citus team, but re: CloudFlare this link might be helpful: https://blog.cloudflare.com/scaling-out-postgresql-for-cloudflare-analytics-using-citusdb/ https://blog.cloudflare.com/scaling-out-postgresql-for-cloud...
- satygeek 11y agoThanks. I went through it but couldnt find info about their cluster size, data size and queries response time
- greggyb 11y agoHundreds of millions of records in <=3 seconds is not really a big challenge with a good data model and proper indexing on even a single server. I work for a BI consultancy and we don't even bat an eye until we hit billions of records in a primary fact table. Certainly the DB server does need to scale vertically to some extent as you pass through the orders of magnitude > 10M. A good columnstore engine is also worthwhile to consider.
- mslot 11y agoYes, Citus may be a good fit, for a complete example see: https://www.citusdata.com/blog/15-marco-slot/402-interactive-analytics-github-data-using-postgresql-citus https://www.citusdata.com/blog/15-marco-slot/402-interactive...