3 ms·
Parquet is not Arrow. Parquet has optimizations for storage size at the expense of compute readiness. Arrow maximizes computation efficiency, at the expense of
by CameronNemo 6y ago
Parquet is not Arrow. Parquet has optimizations for storage size at the expense of compute readiness. Arrow maximizes computation efficiency, at the expense of storage size.
Read more here: https://stackoverflow.com/questions/56472727/difference-between-apache-parquet-and-arrow https://stackoverflow.com/questions/56472727/difference-betw...
- prepend 6y agoI used arrow to read and write parquets across environments. Thats my dumb reason for finding arrow so useful.