3 ms·
https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_parquet.html https://pandas.pydata.org/pandas-docs/stable/reference/api/p...
by poorman 6y ago
https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_parquet.html https://pandas.pydata.org/pandas-docs/stable/reference/api/p...
- nerdponx 6y ago+1, in my experience the Pandas CSV parser seems very robust and more than sufficiently fast. The only faster/better CSV parser I've used with any frequency is the fread function in the R package data.table. When I used R in the past, Parquet was much less popular, but I think now the arrow package supports writing to Parquet.