4 ms·

I'm guessing the next stage will be to keep the raw data and aggregate dynamically. We went through a similar progression with ad audiences -- maintaining pre-a

I'm guessing the next stage will be to keep the raw data and aggregate dynamically. We went through a similar progression with ad audiences -- maintaining pre-aggregated data sketches and summaries was such a PITA that we likely saved money by moving to a larger raw-facts database. > OLAP databases are not good at serving large volumes of requests with low latency within milliseconds. Just use Vertica lol.

lima 2y ago
Use Clickhouse - it's specifically built for this use case (low latency OLAP).
- derekperkins 2y ago
  It also has materialized views built in so you don't have to run dbt manually
- kwillets 2y ago
  Yes, I almost added that -- there are several alternatives, but it takes some testing and tuning to be certain.