25 ms·
having an embedded column database for analytics in your traditional db is a massive win for productivity + operations simplicity. at the moment I use PG + Tig
by dzonga 9mo ago
having an embedded column database for analytics in your traditional db is a massive win for productivity + operations simplicity.
at the moment I use PG + Tiger Data - couldn't find a mysql equivalent
so this as one.
- travem 9mo agoOne option is TiDB. It has support for columnar data alongside row based data. However, it is MySQL compatible, but not based on MySQL code so not quite what you asked for.
- dveeden2 9mo agoYes, TiDB has columnar data and also Vector support. All open source and MySQL compatible.
- tempest_ 9mo agoCan tiger data be used just as a simple column store? All I want is effectively what clickhouse does in PG. I have a single table that I need fast counts on and clickhouse can do the counts fast but I have to go through the entire sync/replication to do that. A quick scan of TimeSeries always seemed like it was really only best setup for that and to use it another way would be a bit of a struggle.
- dzonga 9mo agoin a way -- materialized views -- but Tiger Data is more optimized for TimeSeries data - https://www.tigerdata.com/docs/use-timescale/latest/hypercore/real-time-analytics-in-hypercore https://www.tigerdata.com/docs/use-timescale/latest/hypercor... I do wish too there was an embedded click house like db in Postgres
- rjh29 9mo agoClickhouse supports MySQL protocol natively, and can also wrap/import MySQL tables. Okay so you need two connections but it works pretty well.
- gempir 9mo agoIt even supported running as a MySQL Replica at some point. "MaterializedMySQL" Sadly that feature seems to have been thrown out, probably due to complexity. https://github.com/ClickHouse/ClickHouse/discussions/44887#discussioncomment-10368737 https://github.com/ClickHouse/ClickHouse/discussions/44887#d... https://www.percona.com/blog/complete-walkthrough-mysql-to-clickhouse-replication-using-materializedmysql-engine/ https://www.percona.com/blog/complete-walkthrough-mysql-to-c... https://github.com/ClickHouse/ClickHouse/pull/73879 https://github.com/ClickHouse/ClickHouse/pull/73879
- tempest_ 9mo agoMostly due to support, at least on the PG side. They bought peerdb and offer it as clickhouse pipes so I suspect the incentive to support that feature is pretty low
- awesome_dude 9mo agoMariaDB has supported columnar tables for a bit https://mariadb.com/resources/blog/see-columnar-storage-for-analytics-in-action-and-get-an-overview-of-mariadb-community-server-10-5/ https://mariadb.com/resources/blog/see-columnar-storage-for-...
- davidkwast 9mo agoI don't think MariaDB ColumnStore has any kind of advantage. It is just an append-only storage format with some columnar concepts. https://vettabase.com/mariadb-columnstore-sql-limitations/#Indexes https://vettabase.com/mariadb-columnstore-sql-limitations/#I...
- mhitza 9mo agoMariadb has a columnar engine already (though I did not use it myself) https://mariadb.com/docs/analytics/mariadb-columnstore/columnstore-quickstart-guides/mariadb-columnstore-guide https://mariadb.com/docs/analytics/mariadb-columnstore/colum... and is mostly mysql compatible. For about a year releases include a vector storage type, so it will be interesting to see it compared in performance with what Alibaba did. Just wanted to plug that out. Given how often Postgres is plugged on HN, I think people ignore how versatile mariadb is.
- davidkwast 9mo agoThis ColumnStore is very simple and just do table scans sequentially on every query. It doesn't support indexes and unique constraints. It is almost an append-only serialization file format, but with some columnar concepts.
- jinjin2 9mo agoMariaDB also has MariaDB Exa, which is a real HTAP solution using Exasol for the analytical workloads: https://mariadb.com/products/exa/ https://mariadb.com/products/exa/
- geab 9mo agoAlso info here: https://www.exasol.com/use-cases/mariadb-exa/ https://www.exasol.com/use-cases/mariadb-exa/