2 ms·

What is the point of simulating 650GB data with ~40 columns if you are going to use a single column for testing? Is that even 16GB?

• KeplerBoy 11mo ago
  It's a strided array and slows down memory access.
  • ayhanfuat 11mo ago
    It's a parquet file. Column data is stored in contiguous pages (and that's how duckdb and polars read them).
    • KeplerBoy 11mo ago
      Okay, wasn't aware of that.