4 ms·

Parquet is not better than csv in every useful way. CSV, being row-oriented, makes it much easier to append data than parquet, which is column-oriented. CSV i

by cout 4y ago

Parquet is not better than csv in every useful way. CSV, being row-oriented, makes it much easier to append data than parquet, which is column-oriented. CSV is also supported by decades of software, much of which either predates parquet or does not yet support parquet. CSV, being a newline-delimited text-based format, is much better suited for inclusion in a git repository than parquet. I use parquet wherever I can, but I still reach for csv whenever it makes sense.

heavenlyblue 4y ago
> CSV is also supported by decades of software, much of which either predates parquet or does not yet support parquet. CSV can not be supported by any software because it's not really a format. If you don't understand what I am saying by this, please write down an algorithm for figuring out which type of quoting is used in a given CSV file. Also please explain to me how you would deal with new lines in the text data.