3 ms·
Hi all, I've spent the past 4 years working as a data analyst and analytics engineer. One of the biggest pain points for analysts is that, even with tools like
by mjirv 5y ago
Hi all,
I've spent the past 4 years working as a data analyst and analytics engineer. One of the biggest pain points for analysts is that, even with tools like Looker and Tableau, they still spend a ton of time answering fairly simple questions from less-technical users instead of doing high-value analytics.
Often as a data analyst I've felt like a computer translating requests from English into SQL. That got me wondering - could an actual computer do it instead?
For a while, I thought the answer was "no" (or at least not in the near future). But then OpenAI's Codex[0] was released. I started using GitHub Copilot[1] every day while writing SQL in Visual Studio, and it felt like magic. The autocomplete was getting my code right a lot of the time, even for complex SQL queries.
So I decided I'd give this a go. I've built a demo using the Codex API and dbt Labs's "Jaffle Shop" example database, which will be familiar to many in the Analytics Engineering community. It's a simple database, but the results are promising. The demo app gets a lot of queries right, and it does so without any database-specific logic.
The only input needed is a schema.yml file describing the tables and columns (which any dbt project would have) and 2 or 3 example queries, so I am hoping to open up testing to more data warehouses and users in the near future.
I hope you enjoy using the demo. If you have any feedback, ideas, or would like to test it out on your own data warehouse, my email is in my bio!
[0] https://openai.com/blog/openai-codex/ https://openai.com/blog/openai-codex/
[1] https://copilot.github.com/ https://copilot.github.com/