3 ms·
Correct. I'm not data warehousing. I'm running a parse-like backend out of Postgres, where I have a lot of duplicated json keys. It would be great to have compr
by azinman2 12y ago
Correct. I'm not data warehousing. I'm running a parse-like backend out of Postgres, where I have a lot of duplicated json keys. It would be great to have compression on the json to include this, while maintaining the other advantages of the json column store. However as they're hierarchical and there are many of them columns aren't appropriate (as far as I know but I haven't benchmarked some crazy dynamic solution... json certainly is easier to work with).
- greggyb 12y agoI would keep an eye on the columnstore space. I know that Microsoft introduced read-only columnstore indices before introducing updateable ones, and their turnaround on it was 2 years - SQL Server 2012 to 2014. I'd use that as the outside end of an estimate for when the Postgres team will get updateable columnstore working.
- ddorian43 12y agoNote, updatetable columnstore sucks everywhere, so I don't think so. It's only for OLAP, not OLTP (parse is oltp). What may help @azinman is group-compression (ex: bigger pages of rows and compress the whole page, where each json-key can be repeated multiple times in a page since each page may have multiple rows). This is what happens on tokudb,hbse,hypertable,cassandra.