Just because people don't write tests and use tooling doesn't mean it doesn't exist! When I write pipelines I write unit tests for the business logic and integ

Just because people don't write tests and use tooling doesn't mean it doesn't exist! When I write pipelines I write unit tests for the business logic and integration tests for the overall process. Whether you use SSIS, Alteryx, Spark whatever you can write tests and you can debug using known inputs, rather than running an entire pipeline to see that is works! These are my typical thoughts on ETL testing: https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelin... https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/ https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-pr... https://the.agilesql.club/2019/09/how-do-test-the-upstream-data-is-good-in-an-etl-process-etl-testing-part-3/ https://the.agilesql.club/2019/09/how-do-test-the-upstream-d... https://the.agilesql.club/2019/10/how-to-test-etl-processes-in-production/ https://the.agilesql.club/2019/10/how-to-test-etl-processes-... ed