4 ms·
In SQL-heavy ETL pipelines, I normally don't test the SQL queries by themselves, but do black box & performance testing to verify that the output of a certain b
by jlund-molfese 4y ago
In SQL-heavy ETL pipelines, I normally don't test the SQL queries by themselves, but do black box & performance testing to verify that the output of a certain batch job matches what I expect (automated acceptance testing).
This is easier if you have the same input every time the tests run, like a frozen database image, because then you can basically have snapshot tests.
- rozularen 4y agowe do something similar, we run some validation tests against the output regarding file size and line count but not the actual data