4 ms·
My company recently started to invest more into analytics and we had to find a good solution on which backend/database we want to decide. After some research we
by derN3rd 4y ago
My company recently started to invest more into analytics and we had to find a good solution on which backend/database we want to decide.
After some research we settled on ClickHouse and we couldn't be happier.
- Super easy to setup
- Easy to backup
- Fast configuration (documentation could be better at some parts)
- Similar SQL dialect as our devs use in MySQL
Only negative points I could find so far:
- No 'good' management GUI as e.g. phpMyAdmin, pgAdmin, Mysql Workbench
- Caching/Batching layers not directly implemented, but through external software
As we are a fairly small company all other analytical databases would have cost us a large amount of money/time more. Friends of us recently hired a group of data engineers/analytics who also brought all their AWS knowledge and toolings with them, which basically brought them to the same outcome as us, while we only have 5% of their costs and all our devs are able to either ingest or query some data
EDIT:
Does anyone have some recommendations on what GUIs I could give our PMs to work with ClickHouse instead of writing queries? All SaaS I found didn't support ClickHouse yet or would cost us a newborn.
Also what tools do your devs use when they work with ClickHouse data?
- blinkov 4y agoJust in case, here's built-in batching https://clickhouse.com/docs/en/operations/settings/settings/#async-insert https://clickhouse.com/docs/en/operations/settings/settings/... and a list of mature UIs https://clickhouse.com/docs/en/connect-a-ui https://clickhouse.com/docs/en/connect-a-ui (that all have SaaS offerings I believe) and all third-party UIs https://clickhouse.com/docs/en/interfaces/third-party/gui https://clickhouse.com/docs/en/interfaces/third-party/gui
- derN3rd 4y agoThanks! I remember trying the built-in batching but we had some trouble with it, so we just switched to <https://github.com/nikepan/clickhouse-bulk https://github.com/nikepan/clickhouse-bulk> which works without any issue since then. Will have a look at the UIs listed there
- gbrits 4y agoClickhouse support for Tableplus landed 2 months ago. https://github.com/TablePlus/TablePlus/issues/670 https://github.com/TablePlus/TablePlus/issues/670
- glogla 4y agoI like a lot of things about Clickhouse but one thing I'm afraid of is what happens when your data won't fit on a single machine. The replication and sharding seems pretty difficult and from reading the documentation feels like it might be pretty fragile. I think once you reach that scale, systems that completely separate data and compute (like snowflake or trino+s3) are much less of a pain to run since even if you completely blow up your compute the data stays. > Does anyone have some recommendations on what GUIs I could give our PMs to work with ClickHouse instead of writing queries? All SaaS I found didn't support ClickHouse yet or would cost us a newborn. Also what tools do your devs use when they work with ClickHouse data? I think both Superset and Metabase were interesting choices - if you want to save money (at the expense of engineering time) you can self-host them.
- nojito 4y agoEbay wrote a great blog post about clustering clickhouse https://tech.ebayinc.com/engineering/ou-online-analytical-processing/ https://tech.ebayinc.com/engineering/ou-online-analytical-pr...
- gaploid 4y agoWe built a Managed ClickHouse service to help exactly these difficulties with that technology. We are handling sharding, clustering, zookeeper, patching, updates without downtime, and Hybrid storage based on S3. https://double.cloud https://double.cloud
- deleted 4y ago[deleted]
- ceeplusplus 4y agoTableau is second to none for dataviz imo. Much more versatile than the competition. You can do interactive visualizations, set thresholds, color code/label data, etc. Of course it costs a lot, but if dataviz is something that is delivering real value the cost is more than worth it.