4 ms·
I'm losing count of all the metadata management systems being open sourced. First there was Wherehows out of LinkedIn [1]. Then there was Amundsen out of Lyft
by iblaine 5y ago
I'm losing count of all the metadata management systems being open sourced. First there was Wherehows out of LinkedIn [1]. Then there was Amundsen out of Lyft, which is now stemma.io [2]. Then there was Marquez out of WeWork [3]. Now we have DataHub out of LI. It's a little crazy how underserved this problem was several years ago and how over served it's becoming.
I use Amundsen and am pretty happy with it.
[1] https://engineering.linkedin.com/blog/2016/03/open-sourcing-wherehows--a-data-discovery-and-lineage-portal https://engineering.linkedin.com/blog/2016/03/open-sourcing-...
[2] https://eng.lyft.com/amundsen-lyfts-data-discovery-metadata-engine-62d27254fbb9?gi=2f233e51dc79 https://eng.lyft.com/amundsen-lyfts-data-discovery-metadata-...
[3] https://marquezproject.github.io/marquez/ https://marquezproject.github.io/marquez/
- marslan2000 5y agoThanks for pointing it out. You may find this post interesting and many of these OSS projects (including DataHub) failed to deliver the promises: https://metaphor.io/blog/why-cant-i-find-the-right-data https://metaphor.io/blog/why-cant-i-find-the-right-data
- adamfeldman 5y agoI think it’s https://www.stemma.ai https://www.stemma.ai. Thank you for this broad list!