3 ms·
If you're looking for "open source Python ETL", two things that are better options: https://dlthub.com/ https://dlthub.com/ https://hub.meltano.com/ https://h
by mritchie712 2y ago
If you're looking for "open source Python ETL", two things that are better options:
https://dlthub.com/ https://dlthub.com/
https://hub.meltano.com/ https://hub.meltano.com/
we[0] use meltano in production and I'm happy with it. I've played around with dlt and it's great, just not a ton of sources yet.
0 - https://www.definite.app/ https://www.definite.app/
- jdnier 2y agoAre you able to describe what makes them better? (Honest question, I'm not familiar with either or with Amphi.) It seems Definite's use case is focused on connecting to lots of data sources. For much smaller scale, how does Amphi compare?
- mritchie712 2y agomost data engineers would think of something like Fivetran when you say "ETL" (look at the ETL section here[0]). It looks like Amphi could handle some low code transformations (the "T" in ETL), but calling it ETL feels like a stretch. So to rephrase a bit, if you're looking for an open source, python based Fivetran alternatives, dlt and meltano would be my picks. 0 - https://mattturck.com/landscape/mad2024.pdf https://mattturck.com/landscape/mad2024.pdf)
- thibautdr 2y agoHey, Amphi's developer here. Those two tools are great, big fan of dlt myself :) However, Amphi is a low-code solution while those two are code-based. Also, those two focus on the ingestion part (EL) while Amphi is focusing on different ETL use-cases (file integration, data preparation, AI pipelines).
- mritchie712 2y agoI understand that. I'd change the title / H1 though, "Open Source Python ETL" doesn't describe what you're building very well. Good luck! Looks cool.