And DuckDB (DuckDB.org) is a lightweight and super fast library/CLI for working with Parquet. It’s SQLite for column formats, and for Python users it’s only a

And DuckDB (DuckDB.org) is a lightweight and super fast library/CLI for working with Parquet. It’s SQLite for column formats, and for Python users it’s only a pip install away. I use it on the command line to inspect and work with Parquet. It’s aliso Pandas compatible and actually more performant than Pandas. No need to use Spark, which is heavy and has tons of boilerplate.