25 ms·
Ultimately regulations will change over time. I think the most important thing to keep in mind is storing data in a form that is amenable to large scale batch t
by jpgvm 5y ago
Ultimately regulations will change over time. I think the most important thing to keep in mind is storing data in a form that is amenable to large scale batch transformation. This way you can respond by kicking off a task to "rewrite the world" to scrub fields or drop records. Bug reason why I encourage stuff like Avro, Parquet or the even just loading to BigQuery.