3 ms·
The Splitgraph core code on GitHub [0], around which we've built the DDN, is all about managing "data images" which are basically snapshots of PostgreSQL schema
by mildbyte 6y ago
The Splitgraph core code on GitHub [0], around which we've built the DDN, is all about managing "data images" which are basically snapshots of PostgreSQL schemata. You can build them with a format similar to Dockerfiles as well as do a "checkout" into a local instance of Splitgraph (which you can connect to with any PG client) -- this enables change tracking and delta compression too.
Behind the scenes, we store them as cstore_fdw [2] files which is a columnar storage format that helps with analytical queries.
[0] https://github.com/splitgraph/splitgraph/ https://github.com/splitgraph/splitgraph/
[1] https://splitgraph.com/docs/concepts/images https://splitgraph.com/docs/concepts/images
[2] https://github.com/citusdata/cstore_fdw https://github.com/citusdata/cstore_fdw