4 ms·
Can Parquet be read/parsed in almost every programming language with very little effort?
by benob 3y ago
Can Parquet be read/parsed in almost every programming language with very little effort?
- vesinisa 3y agoExactly. The author even opens the article with the nice trivia that CSV has been in use since the 1970s. I don't think anyone disputes that CSV is a very primitive format. But I hope no one uses CSV because it is so performant or well-designed. It is used exactly because it is so universal, which makes the point of comparing against almost any other format moot unless they were around in the 1970s, too.
- bluenose69 3y agoI just tried it in R. The relevant package seems to be "arrow", so I did install.packages("arrow") and then I did ?read_parquet to get an example. I tried the example, and got the error message as follows. This sort of error is really quite uncommon in R. So my answer to the "with little effort" is "no", at least for R. > tf<-tempfile() > write_parquet(mtcars, tf) Error in parquet___WriterProperties___Builder__create() : Cannot call parquet___WriterProperties___Builder__create(). See https://arrow.apache.org/docs/r/articles/install.html for help installing Arrow C++ libraries.
- 2devnull 3y agoArrow going back and forth between r/python can be a catch too iirc.
- addandsubtract 3y agoMore importantly, can you open parquet files in Excel?
- JumpCrisscross 3y agoNo, you have to convert it to CSV first [1]. Or install a driver [2]. [1] https://www.gigasheet.com/post/how-to-open-parquet-file https://www.gigasheet.com/post/how-to-open-parquet-file [2] https://www.cdata.com/kb/tech/parquet-odbc-excel-query.rst https://www.cdata.com/kb/tech/parquet-odbc-excel-query.rst