3 ms·
Any reason you're using CSV instead of parquet?
by shoemakersteve 1y ago
Any reason you're using CSV instead of parquet?
- epistasis 1y agoCSV seems to be a natural and easy fit. What advantage could parquet bring that would outweigh the disadvantage of adding two new dependencies? (One in Python and one in R)
- pjacotg 1y agoNot the op, but I started using parquet instead of CSV because the types of the columns are preserved. At one point I was caching data to CSV but when you load the CSV again the types of certain columns like datetimes had to be set again. I guess you'll need to decide whether this is a big enough issue to warrant the new dependencies.
- pletnes 1y agoMany of the reasons csv is bad is because you don’t control both reader and writer. Here, if you’re 2 persons that collaborate OK, they should be fine.