3 ms·
I just published our approach to pseudo anonymization and sort of anonymization. We'd built a tool which can traverse data extract the pii data and put back a
by kjuulh 2y ago
I just published our approach to pseudo anonymization and sort of anonymization.
We'd built a tool which can traverse data extract the pii data and put back a token into the data. Before one of our allowed systems would read the data we'd swap in the actual data or an anonymized version if we didn't permission to use it anymore. So we sort of get the best of both worlds we can use the actual data of our customers because we require it, but can safely use data for analytics and retain a lot of the statistical variance of our data.
Crazy complex project to work on given our limited resources but very fulfilling in the end.
It should be mentioned that I don't mention the difference between anonymization and pseudo anonymization in the article mostly because I didn't know it was really a thing. I just implemented a solution given or requirements
https://tech.lunar.app/blog/data-anonymization-at-scale https://tech.lunar.app/blog/data-anonymization-at-scale
- 3abiton 2y agoNice article, but a bit different than the OP authors who published a fully fledged open-source tool, is your code also available open-source for the community?
- kjuulh 2y agoSadly not, it is very much tied to our workflows and as such wouldnt provide much value for anyone else other than a reference. Nevertheless I thought I'd share our approach to anonymization / pseudoanomyzation as I haven't really seen that done elsewhere.
- edrenova 2y agoNice! appreciate you sharing it - would love to see the code at some point but looks like it's confidential. I spent a lot of time building tokenization solutions at a previous startup so we'll definitely support tokenization at some point. There is a good use-case for it as well!