6 ms·
DBT (data build tool) [0] embraces this idea - it's like make for data transformation. Just like make its syntax is sub-optimal. But that's the only draw-back.
by oneofthose 7y ago
DBT (data build tool) [0] embraces this idea - it's like make for data transformation. Just like make its syntax is sub-optimal. But that's the only draw-back. There is an open source version, it generates documentation automatically, you can materialize tables on a schedule, it allows you to write unit tests for your data ("this select must return 0 rows" kind of tests). I'm not affiliated with them, just happy user.
[0] https://www.getdbt.com/ https://www.getdbt.com/
- mmeasic 7y agoYes, that was my first thought when I opened the article. dbt is amazing and basically converts your SELECT statements to CREATE TABLE statements. I guess they target both EL from the ELT, while dbt relies on data being in your data warehouse.