5 ms·

What is the best alternative for BigQuery? What is the most economical? Once you are hooked, it is really hard to imagine going to e.g Redshift

crop_rotation 4y ago
Snowflake seems most similar, plus you would get to stay on GCP.
rekttrader 4y ago
Export your data via avro files and try using Athena
- erikcw 4y ago
  Ideally you’d used Parquet or ORC if querying from Athena/Trino/Presto. Since they are columnar formats you will enjoy considerably faster queues and lower query costs for most query patterns other than “select *…” since the query engine can just retrieve the columns needed for your query instead of the entire row.
  - mateo411 4y ago
    100 percent correct. Ideally you will also partition the data, so your queries can use partitions. Athena charges $5 per terabyte of data scanned, so it's important to get this right.
jread 4y ago
Athena and Redshift Spectrum are the best alternatives on the AWS side.
veeti 4y ago
Buy the biggest server on Hetzner and install ClickHouse (/s?)
- re-thc 4y ago
  There's also ClickHouse Cloud now.
  - hodgesrm 4y ago
    Even better, there are lots of ClickHouse clouds! ClickHouse Cloud, Altinity.Cloud, DoubleCloud, Aiven, TinyBird...plus many others. This is the best assurance for users that prices for ClickHouse will stay competitive over time. Disclaimer: I work at Altinity.
nycdatasci 4y ago
Snowflake is easily the best alternative. It's a little expensive, but it just works.
- weego 4y ago
  I could never understand how to go about guesstimating what snowflake would cost, their pricing abstraction feels like lunacy as an outsider.
  - disgruntledphd2 4y ago
    They're the Oracle of cloud databases. Great product, pricing models are pretty insane. And despite the pricing, they're still losing money!
  - bhouston 4y ago
    That is because they figure out what you will pay and that is what they charge. It is completely disconnected from the costs involved.
- berkle4455 4y ago
  Slowflake isn’t really an alternative if someone is switching due to costs. It’s generally more expensive for the same workloads.
- HDThoreaun 4y ago
  Snowflake is much slower than BigQuery in my experience.
  - CommanderHux 4y ago
    For which workload?
    - deleted 4y ago
      [deleted]
- 4y ago
samtp 4y ago
May be a slightly different use case but moving from BigQuery to managed Clickhouse on clickhouse.com has been pretty great. Easy data injection, super fast querying, lots of control over the environment, and a nice SQL console for quickly looking at the data.
adityapatadia 4y ago
We at https://www.gumlet.com https://www.gumlet.com use bigquery a lot, but now it seems we will have to move to click house. Can’t trust google with anything. First Kubernetes price intro, then multi region storage price increase along with inter region price introduction and now this. I would trust AWS but not Google.

crop_rotation 4y ago

Snowflake seems most similar, plus you would get to stay on GCP.

rekttrader 4y ago

Export your data via avro files and try using Athena

erikcw 4y ago
Ideally you’d used Parquet or ORC if querying from Athena/Trino/Presto. Since they are columnar formats you will enjoy considerably faster queues and lower query costs for most query patterns other than “select *…” since the query engine can just retrieve the columns needed for your query instead of the entire row.
- mateo411 4y ago
  100 percent correct. Ideally you will also partition the data, so your queries can use partitions. Athena charges $5 per terabyte of data scanned, so it's important to get this right.

jread 4y ago

Athena and Redshift Spectrum are the best alternatives on the AWS side.

veeti 4y ago

Buy the biggest server on Hetzner and install ClickHouse (/s?)

re-thc 4y ago
There's also ClickHouse Cloud now.
- hodgesrm 4y ago
  Even better, there are lots of ClickHouse clouds! ClickHouse Cloud, Altinity.Cloud, DoubleCloud, Aiven, TinyBird...plus many others. This is the best assurance for users that prices for ClickHouse will stay competitive over time. Disclaimer: I work at Altinity.

nycdatasci 4y ago

Snowflake is easily the best alternative. It's a little expensive, but it just works.

weego 4y ago
I could never understand how to go about guesstimating what snowflake would cost, their pricing abstraction feels like lunacy as an outsider.
- disgruntledphd2 4y ago
  They're the Oracle of cloud databases. Great product, pricing models are pretty insane. And despite the pricing, they're still losing money!
- bhouston 4y ago
  That is because they figure out what you will pay and that is what they charge. It is completely disconnected from the costs involved.
berkle4455 4y ago
Slowflake isn’t really an alternative if someone is switching due to costs. It’s generally more expensive for the same workloads.
HDThoreaun 4y ago
Snowflake is much slower than BigQuery in my experience.
- CommanderHux 4y ago
  For which workload?
  - deleted 4y ago
    [deleted]
4y ago

samtp 4y ago

May be a slightly different use case but moving from BigQuery to managed Clickhouse on clickhouse.com has been pretty great. Easy data injection, super fast querying, lots of control over the environment, and a nice SQL console for quickly looking at the data.

adityapatadia 4y ago

We at https://www.gumlet.com https://www.gumlet.com use bigquery a lot, but now it seems we will have to move to click house. Can’t trust google with anything. First Kubernetes price intro, then multi region storage price increase along with inter region price introduction and now this. I would trust AWS but not Google.