4 ms·
This is awesome! I had a look at how to use this. The video I watched is a couple years old, but probably mostly relevant still. https://youtu.be/nORS7STbLyk h
by codetrotter 3y ago
This is awesome!
I had a look at how to use this. The video I watched is a couple years old, but probably mostly relevant still. https://youtu.be/nORS7STbLyk https://youtu.be/nORS7STbLyk
The thing that really resonates with me here is the way they use faceting to find bad data.
When I write pipelines on the command line, I sometimes find it necessary to filter and select data in various ways. Because of this I end up rerunning cli pipelines multiple times sometimes. If instead I dump it to csv I could see myself using OpenRefine with its faceting to pick out the relevant data for processing