4 ms·
How do you end up with two identical SQL tables in the first place?
by abujazar 3y ago
How do you end up with two identical SQL tables in the first place?
- hypercube33 3y agoI immediately considered it for comparison of backups.
- theodpHN 3y agoRegression testing.
- nxx788 3y ago[dead]
- remywang 3y agograding homework
- thedirt0115 3y agoConsider owning an ETL system where users can create periodic jobs, like calculating a "daily active user" rollup table from a bunch of event source tables. Now consider being asked to switch the query execution engine from A to B, perhaps because engine B is much more cost-effective for your system's query patterns. Ex: You are tasked with switching from MapReduce to Tez, from Presto to Spark, etc. Before full migration, you can reduce risk by double-writing jobs, with engine A writing to the standard output location, and engine B writing to some other migration location. This should lead to two identical SQL tables, which you should then verify, because sometimes these execution engines have bugs hiding in the corners :)