4 ms·
This looks pretty cool! What was the hardest part about building this?
by matijash 3y ago
This looks pretty cool! What was the hardest part about building this?
- karakanb 3y agohey, thanks! I guess there were a couple of things that I found as tricky: - deciding on the right way to represent sources and destinations was hard, before landing on URIs I thought of using config files but that'd also add additional complexity etc - the platforms had different quirks concerning different data types - dlt stores state on its own, which means that re-runs are not running from scratch after changing the incremental strategy, and they require a full refresh, it took me quite some time to figure out how exactly to work with it I think among these the hardest part was to get myself to build and release it, because I had it in my mind for a long time and it took me a _long while_ to build and share it :)