6 ms·

Is it faster for querying than using Presto on top of Hive? The page comparing ClickHouse with other analytics solutions doesn’t list Presto, which is very popu

Is it faster for querying than using Presto on top of Hive? The page comparing ClickHouse with other analytics solutions doesn’t list Presto, which is very popular these days.

FridgeSeal 5y ago
Last time I looked it was significantly faster. Last stats I saw had Presto in the 1-to-several-seconds range and CH in the 10/100 ms range.
vulkoingim 5y ago
Waay faster. In my experience it has been the fastest OLAP db I've ever used, and by a wide margin. I don't think any other system gets close for the price/performance ratio you get with ClickHouse. In this blog [1] you can find a very nice comparison of different dbs on the same dataset/same queries The fastest Presto benchmark there [2] vs ClickHouse on a single node core i5 [3] vs ClickHouse in cluster mode [4] [1] https://tech.marksblogg.com/benchmarks.html https://tech.marksblogg.com/benchmarks.html [2] https://tech.marksblogg.com/billion-nyc-taxi-rides-spark-2-4-versus-presto-214.html https://tech.marksblogg.com/billion-nyc-taxi-rides-spark-2-4... [3] https://tech.marksblogg.com/billion-nyc-taxi-clickhouse.html https://tech.marksblogg.com/billion-nyc-taxi-clickhouse.html NOTE: not really comparable, since it's on single machine, but I think it really shows what ClickHouse is capable of [4] https://tech.marksblogg.com/billion-nyc-taxi-rides-clickhouse-cluster.html https://tech.marksblogg.com/billion-nyc-taxi-rides-clickhous...
- beagle3 5y ago
  Kdb+ or it’s latest incarnation k9/shakti are likely faster, but they cost a few arms and a few legs. Once you factor price into the equation, click house is infinitely better :)
  - vulkoingim 5y ago
    Absolutely. That's why I said price/performance might be the best. Also MapD (nowadays OmniSci) is way faster.... but it would cost you a couple of bodies probably to run on GPUs :)
- mikpanko 5y ago
  Thank you for the links! Do you happen to know where Facebook’s Scuba, Google’s Procella, Google’s Dremel on Capacitor and Snowflake come on that list of benchmarks?
  - FridgeSeal 5y ago
    Scuba appears to be an in-memory-only database, so it’s possibly faster (not seen benchmarks nor used it) but at the cost of persistence. Is Procella even usable by anyone not-google? Haven’t used dremel + capacitor, but have used Snowflake and found it lacking. Promises a lot, performance was just kind of alright, support was useless, sales team was aggressive to the point of harassment, and it was eye-wateringly expensive on top of all that. Some people love it, I will never go near it again, it’s advantages just aren’t sufficient to warrant choosing it over ClickHouse or even Redshift.
- drewpc 5y ago
  Thanks for these links. Unrelated to ClickHouse, it was interesting to read about BrytlytDB--I'd never heard of it before. Essentially a PostgreSQL DB that uses GPUs.
ckdarby 5y ago
You should look at switching from hive to Iceberg. You'll see a 4-10x speed up and it'll start to give Clickhouse a run for it's money.

Is it faster for querying than using Presto on top of Hive? The page comparing ClickHouse with other analytics solutions doesn’t list Presto, which is very popular these days.

FridgeSeal 5y ago

Last time I looked it was significantly faster. Last stats I saw had Presto in the 1-to-several-seconds range and CH in the 10/100 ms range.

vulkoingim 5y ago

Waay faster. In my experience it has been the fastest OLAP db I've ever used, and by a wide margin. I don't think any other system gets close for the price/performance ratio you get with ClickHouse. In this blog [1] you can find a very nice comparison of different dbs on the same dataset/same queries The fastest Presto benchmark there [2] vs ClickHouse on a single node core i5 [3] vs ClickHouse in cluster mode [4] [1] https://tech.marksblogg.com/benchmarks.html https://tech.marksblogg.com/benchmarks.html [2] https://tech.marksblogg.com/billion-nyc-taxi-rides-spark-2-4-versus-presto-214.html https://tech.marksblogg.com/billion-nyc-taxi-rides-spark-2-4... [3] https://tech.marksblogg.com/billion-nyc-taxi-clickhouse.html https://tech.marksblogg.com/billion-nyc-taxi-clickhouse.html NOTE: not really comparable, since it's on single machine, but I think it really shows what ClickHouse is capable of [4] https://tech.marksblogg.com/billion-nyc-taxi-rides-clickhouse-cluster.html https://tech.marksblogg.com/billion-nyc-taxi-rides-clickhous...

beagle3 5y ago
Kdb+ or it’s latest incarnation k9/shakti are likely faster, but they cost a few arms and a few legs. Once you factor price into the equation, click house is infinitely better :)
- vulkoingim 5y ago
  Absolutely. That's why I said price/performance might be the best. Also MapD (nowadays OmniSci) is way faster.... but it would cost you a couple of bodies probably to run on GPUs :)
mikpanko 5y ago
Thank you for the links! Do you happen to know where Facebook’s Scuba, Google’s Procella, Google’s Dremel on Capacitor and Snowflake come on that list of benchmarks?
- FridgeSeal 5y ago
  Scuba appears to be an in-memory-only database, so it’s possibly faster (not seen benchmarks nor used it) but at the cost of persistence. Is Procella even usable by anyone not-google? Haven’t used dremel + capacitor, but have used Snowflake and found it lacking. Promises a lot, performance was just kind of alright, support was useless, sales team was aggressive to the point of harassment, and it was eye-wateringly expensive on top of all that. Some people love it, I will never go near it again, it’s advantages just aren’t sufficient to warrant choosing it over ClickHouse or even Redshift.
drewpc 5y ago
Thanks for these links. Unrelated to ClickHouse, it was interesting to read about BrytlytDB--I'd never heard of it before. Essentially a PostgreSQL DB that uses GPUs.

ckdarby 5y ago

You should look at switching from hive to Iceberg. You'll see a 4-10x speed up and it'll start to give Clickhouse a run for it's money.