3 ms·
Hello everyone! Let me introduce my open source project — nxs-data-anonymizer. It's a tool for anonymizing PostgreSQL and MySQL databases dumps. Why do you nee
by nxs_nxs 3y ago
Hello everyone! Let me introduce my open source project — nxs-data-anonymizer. It's a tool for anonymizing PostgreSQL and MySQL databases dumps.
Why do you need an anonymizer?
Usually you need some data for development but where you can find them? The easiest way — take them from a production database but I'm sure security guys will be against. Another way — take data from a production database, delete all sensitive data and run a databases server only for developers. But it's inconvenient for developers. This problem can be solved by anonymized databases dumps. nxs-data-anonymizer automatizes the process of making "fresh dump".
Features
- PgSQL (all versions) and MySQL/MariaDB/Percona (all versions) are supported
- Flexible data faking based on Go templates and Sprig template library like the Helm. Also you may use a values of other columns for same row to build more flexible rules
- Stream data processing. That's mean you can a use the tool through a pipe in command line and redirect dump from source DB directly to the destination DB with required transformations
- Easy to integrate into your CI/CD
I would be grateful for your PR and stars!
- zX41ZdbW 3y agoI recommend taking a look at a similar project I've implemented: clickhouse-obfuscator. It is described here: https://github.com/ClickHouse/ClickHouse/tree/master/programs/obfuscator https://github.com/ClickHouse/ClickHouse/tree/master/program... (implementation details, usage examples, and the motivation for the approach).
- nxs_nxs 3y agoThank you! I'll answer on GitHub if you don't mind :)