3 ms·
People that do proper ETL don't use python
by trollied 3y ago
People that do proper ETL don't use python
- speedgoose 3y agoReal programmers use butterflies. https://xkcd.com/378/ https://xkcd.com/378/
- condwanaland 3y agoI wish they did though. 80% of my day job is (admittedly non-traditional) ETL. It's done in 100% PySpark. More composable than SQL. Have plenty of utility functions wrapped up (which are far easier than stored procedures) in libraries. The code is far easier to step through with a debugger (due to the composability).