3 ms·

650GB relates to size of parquet files which are compressed in reality it’s way more. 32 GB of parquet cannot fit in 32GB of RAM

• barrkel 11mo ago
  This would speed things up since it looks like the bottleneck here is I/O.
• m00x 11mo ago
  You don't need it to if you just need specific columns. This is the advantage of columnar storage.