3 ms·
> The fastest, most compressed columnar format for big data How large a dataset can it tackle? I work with Parquet files spanning 300million+ records (~800MB f
by microflash 4mo ago
> The fastest, most compressed columnar format for big data
How large a dataset can it tackle? I work with Parquet files spanning 300million+ records (~800MB files) using DuckDB and it works within seconds.
I might be interested to see benchmarks against Parquet and Vortex. A DuckDB extension would be great as well.