4 ms·
ClickHouse to Serve Real-Time Queries on Top of BigQuery Data
- nickp71 4y agoI am looking forward to reading more about how ClickHouse is being used with BigQuery
- zX41ZdbW 4y agoWhen I tested BigQuery for ClickBench, the minimum query latency was 0.5 seconds. However, there is some feature for better query latency (need to check). Note: BigQuery has a "De-Witt" clause[2] that prevents publishing the benchmark results. That's why there are all the testing instructions, but no published results: https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-database https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-d... Nevertheless, BigQuery is good for long-running queries, as the number of query workers is selected dynamically on a per-query basis. [1] ClickBench: https://github.com/ClickHouse/ClickBench/ https://github.com/ClickHouse/ClickBench/ [2] https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-database https://cube.dev/blog/dewitt-clause-or-can-you-benchmark-a-d...
- sdairs 4y agoIt's a shame that ClickHouse Inc has not tried to solve the operational complexity of doing this. You might get some performance out of your queries, but at the cost of adding a bunch of new tools & infrastructure just so you can duplicate some data into yet another database. If all you offer is faster SQL, its a tough trade off to make.