3 ms·
dbt [1] is a tool that is deceptively simple, but kind of created a new job role: analytics engineer. It allow you to define tables using SQL plus Jinja2, so yo
by vitorbaptistaa 6y ago
dbt [1] is a tool that is deceptively simple, but kind of created a new job role: analytics engineer. It allow you to define tables using SQL plus Jinja2, so you can add loops and variables to create your SQL code. It might sound complicated, but it's a pleasure to work with.
This improvement was only possible because of other improvements in cloud databases and reductions in storage costs, which allowed us to go from ETL, where we transform the data outside of the database, to ELT, where we load the raw data in the DB and transform it using SQL.
All these improvements taken together allows a single person to do a job that required a small team not many years ago.
[1] https://www.getdbt.com/ https://www.getdbt.com/
- sails 6y agoAgree, this was a huge improvement on workflow in analytics.