3 ms·
If the attributes are scalar, I would still suggest a column store that supports null values. Column compression will save you much space and give you excellent
by icsa 2y ago
If the attributes are scalar, I would still suggest a column store that supports null values. Column compression will save you much space and give you excellent OLAP query performance.
As the schema evolves, simply add new columns.
- paperwhite 2y agoChecked Some attributes are scalar but others are not There are array of objects in a lot of places. will need to modify the schema to be completely scalar Will run a local test & see how this goes. Thanks a lot!
- icsa 2y agoIf the arrays of objects can conform to a single schema (across all scalar attributes), then make a second table to hold the objects in the arrays. Now you have a two table schema with (at most) one join in a given query. Check out Vertica. It does a great job at various forms of compression. In addition, DuckDB is an easy way to get started with efficient OLAP queries.