3 ms·
Do you have recommendations for guides and tools to automatically get a sanitized subset of prod data of Postgres for development? I haven't looked into it in
by smoe 5y ago
Do you have recommendations for guides and tools to automatically get a sanitized subset of prod data of Postgres for development?
I haven't looked into it in a while and the last time we ended up rolling our own.
- dijit 5y agoI don't think there are ready made tools, it's usually custom in every environment I’ve worked in. Any tool for doing this would have to be so generalised as to be extremely difficult to configure I believe (as difficult maybe as setting it up with custom shell scripts)
- shabble 5y agoyou could have a look at dblab[1] which (afaik, I've not yet tried using them) has some support for streaming in from a primary source and applying sanitisation functions/transforms The main value is the use of ZFS snapshots to give you almost-instant (2-3s for a 20G DB on my dev laptop) writeable clone of an import, which you can test your migrations etc against, and then just revert or destroy, which has been extremely helpful for me. Happy user, no relationship, etc. [1] https://postgres.ai/products/how-it-works https://postgres.ai/products/how-it-works