3 ms·

Any recommendations on which binary format to use when I want to store all the DataFrames to disk in order to load them at a later point? My data as an indented

Any recommendations on which binary format to use when I want to store all the DataFrames to disk in order to load them at a later point? My data as an indented JSON file takes up around 800 MB.

congoe 3y ago
Parquet works well as it natively support Apache Arrow, the underlying data structure.