3 ms·
It’s interesting that I never considered why OLTP and OLAP are basically orthogonal technologies. Are there any major players that have an integrated solution f
by appplication 3y ago
It’s interesting that I never considered why OLTP and OLAP are basically orthogonal technologies. Are there any major players that have an integrated solution for both?
I guess it makes sense because the infra is so different, but I’m not sure whether it need be.
- barrkel 3y agoEffecient OLAP queries need a different shape of data - some combination of columnar storage for efficient scanning, and roll-up tables with pre-aggregated measures. Even in an integrated scenario, behind the scenes there will need to be a bunch of copying to transpose and / or refresh roll-ups.
- taeric 3y agoThe pre-aggregation is one too many try and skip. People seem to think they can build a single schema to rule all things, and then assume they can quickly calculate any aggregation on demand.
- esafak 3y agoAs far as the big players are concerned, Google offers AlloyDB (https://cloud.google.com/alloydb https://cloud.google.com/alloydb) while Amazon offers Aurora (https://aws.amazon.com/rds/aurora/ https://aws.amazon.com/rds/aurora/)
- anentropic 3y agoI had understood Aurora as just cloud-native MySQL / PostgreSQL How does that relate to the OLTP vs OLAP dimension? Are they not both primarily OLTP dbs still?
- xvinci 3y agoI think they have, they are just not that well known. E.g. SQL Server - https://learn.microsoft.com/en-us/sql/relational-databases/indexes/columnstore-indexes-overview?view=sql-server-ver16 https://learn.microsoft.com/en-us/sql/relational-databases/i... - you can also find quite a lot of papers by microsoft employees on the designs and capabilities (starting around 2016 I believe, so "pretty new"). I have used it with TPC-H and it worked wonders, never got around to using it in a production workload though.