3 ms·
Not exactly the same, but we wrote a library to easily load any delimited type of file and finds header (even if not first row). It also works to load JSON, Par
by citilife 5y ago
Not exactly the same, but we wrote a library to easily load any delimited type of file and finds header (even if not first row). It also works to load JSON, Parquet, AVRO and loads it into a dataframe. Not CLI exactly, but pretty easy:
https://github.com/capitalone/dataprofiler https://github.com/capitalone/dataprofiler
Can Install: pip install dataprofiler[ml] --user
How it works:
csv_data = Data('your_file.csv') # Load: delimited, JSON, Parquet, Avro
csv_data.data.head(10) # Get head
csv_data.data.sort_values(by='name', inplace=True) # Sort
Anyway, pretty interesting Miller CLI. I'm not sure how the header detection works, especially if the header isn't the first row (which is often the case)
- snthpy 5y agoThanks. This looks very cool.