43 ms·
A similar tool was discussed a few days ago. OpenRefine. https://news.ycombinator.com/item?id=37970800 https://news.ycombinator.com/item?id=37970800
by totetsu 3y ago
A similar tool was discussed a few days ago. OpenRefine. https://news.ycombinator.com/item?id=37970800 https://news.ycombinator.com/item?id=37970800
- adrianbr 3y agodlt is a python library that you can probably plug into the OpenRefine java application to enable moving the data somewhere easily and into different formats, making OpenRefine more useful in a connected environment. I would not say they are similar - rather OpenRefine is made for visual data cleaning, while dlt is made for automation of data movement with structuring and typing to enable crossing different format standards with ease. Together you should have a good combination of automation and manual tweaking option if needed.
- raltjos 3y agoI'd say they're complimentary. One could use dlt to load the data and then use OpenRefine for to clean/transform it. dlt already does when combined with dbt, for example.
- macintux 3y agoFor future reference, that's "complementary". By far one of the most common mistakes (at least, among relatively uncommon words).