4 ms·
You could already run SQL on Parquet with DuckDB (even on Java). I believe it already used Arrow under the hood to read the Parquet files, could be wrong tho, b
by TheGuyWhoCodes 5y ago
You could already run SQL on Parquet with DuckDB (even on Java).
I believe it already used Arrow under the hood to read the Parquet files, could be wrong tho, but this is a more memory performant integration which is great.
- infinite8s 5y agoDuckDB can read parquet directly - however the interesting bit is that the results of SQL queries can be returned as arrow objects into python for further processing (by pyarrow/pandas).
- hfmuehleisen 5y agoDuckDB has its own Parquet reader