3 ms·
Please don’t do this for actual work you share with other people. There’s a good reason why pandas exists.
by qtd6214 3y ago
Please don’t do this for actual work you share with other people. There’s a good reason why pandas exists.
- trollied 3y agoPeople that do proper ETL don't use python
- speedgoose 3y agoReal programmers use butterflies. https://xkcd.com/378/ https://xkcd.com/378/
- condwanaland 3y agoI wish they did though. 80% of my day job is (admittedly non-traditional) ETL. It's done in 100% PySpark. More composable than SQL. Have plenty of utility functions wrapped up (which are far easier than stored procedures) in libraries. The code is far easier to step through with a debugger (due to the composability).