3 ms·
I'm a big fan of big query as well, but the cost can be problematic if you're not careful. Generally speaking I've found it manageable if you make good use of
by mnahkies 3y ago
I'm a big fan of big query as well, but the cost can be problematic if you're not careful.
Generally speaking I've found it manageable if you make good use of partitioning and do incremental aggregation (we use dbt, though you have to do some macro gymnastics to make the partition key filter eligible for pruning due to restrictions on use of dynamic values https://docs.getdbt.com/docs/build/incremental-models https://docs.getdbt.com/docs/build/incremental-models)
It's also important to monitor your cost and watch for the point where switching from the per-tb queried pricing model to slots makes sense.
- alooPotato 3y agoyeah between partitioning, clustering, materialized views, and smart tuning it seems like there are enough knobs to control costs.