4 ms·
In my experience one of the places where every framework breaks down is when you must combine / reconcile multiple rows from multiple data sources to produce on
by endlessvoid94 8y ago
In my experience one of the places where every framework breaks down is when you must combine / reconcile multiple rows from multiple data sources to produce one row in a fact table.
Does there exist a "framework" that lets me do this simply?
- martin_loetzsch 8y ago(author here) The mara example project [1] does exactly that. It combines PuPI download stats with Github repo activity data. [1] https://github.com/mara/mara-example-project https://github.com/mara/mara-example-project
- endlessvoid94 8y agoThanks! Just took a look. The file directory structure is a bit confusing -- could you point me to the file that performs this transformation?
- martin_loetzsch 8y agoFor example the PyPI download stats pipeline is here: https://github.com/mara/mara-example-project/tree/master/app/data_integration/pipelines/pypi https://github.com/mara/mara-example-project/tree/master/app... The __init__.py contains the pipeline, and the rest is the SQL files that do the transformations
- endlessvoid94 8y agoThank you!