4 ms·
Show HN: Bender – Let's Standardize Serverless ETL
- RubenSandwich 9y agoETL stands for Extract, Transform and Load. So this is a data pipeline framework. Nextdoor please put that in your blog post as I do not believe it is a very common acronym.
- techwizrd 9y agoIt's not that uncommon, especially in data science/analytics/engineering. I've definitely heard "ETL" more often that data pipeline or analytics pipeline. This is a nice list[0] of ETL software. 0: https://github.com/pawl/awesome-etl https://github.com/pawl/awesome-etl
- sbuttgereit 9y agoNot uncommon in the ERP/Enterprise/Business computing either. (I say that while I'm working on just such a project for a food distributor).
- gipp 9y agoIt is an extremely common acronym.
- vidarh 9y agoIt's an extremely common acronym in a small niche. So while you're right, sort of, it's still worth clarifying when posted to a more general site.
- lloydde 9y agoIt’s not a small niche. Search any job board and ETL will show up in a large presentage of job posts and resumes related to software QA and data validations.
- _jal 9y agoIt is the kind of acronym that is known by anyone who needs it, modulo those two random people somewhere in the world who just discovered today that they need it but haven't googled the problem yet. Admittedly, it is also the sort of acronym that, when you don't know it, is really annoying in a headline.
- taude 9y agoI'll leave you with a link to Wikipedia [1]. ETL goes back a long, long way, and is still commonly used all through the industry, except maybe in startups composed of all young, inexperienced people. [1] https://en.wikipedia.org/wiki/Extract,_transform,_load https://en.wikipedia.org/wiki/Extract,_transform,_load
- manigandham 9y agoETL as a term has been around for decades and is very well used and understood in pretty much all IT, data, software and enterprise scenarios.
- throwaway2016a 9y agoThank you for pointing that out. I would have myself made the mistakes of assuming the terms is ubiquitous and everyone already knows it. I have heard it used liberally at every job I've done in the last 15 years. I would have termed it a "very very common acronym." Right up there with API. But your post reminds me that not everyone's experiences are the same.
- john_teller02 9y agoIts nice but AWS released GLUE for similar use case a couple of weeks back
- snowpalmer 9y agoI have so far been unimpressed with GLUE.
- throway_foo_bar 9y agoLink to the source in the document doesn't work.
- diranged 9y agoCan you point me to where -- I scanned through the Blog and havn't found a bad link yet?
- throway_foo_bar 9y agoThe last link, to github, was to some internal repo. It has since been fixed.
- slagfart 9y agoGobblin (https://gobblin.apache.org/ https://gobblin.apache.org/), which looks like it does something similar, can be packaged up as a single .jar, and run on AWS Lambda. Anyone had working experience with either?
- throwaway2016a 9y agoGreat work. I'm in the process of writing an ETL and while I don't think this will suite our needs (so unfortunately I need to keep writing) this article provides a lot of great detail that helped me see the process more clearly.