3 ms·
I'm thinking about writing a small tool in Python to automate some ETL tasks. Basically we have an ETL framework where we need to provide an avro schema and a
by markus_zhang 5y ago
I'm thinking about writing a small tool in Python to automate some ETL tasks.
Basically we have an ETL framework where we need to provide an avro schema and a yaml transformation file. Config-boy type of work is very boring so I plan to write a tool to consume a few JSONs and generate the two files, or at least the majority part of the files. It's somewhat tricky for complex JSONs but my script will simply pass any JSON array/object to manual work.