3 ms·
Exactly, I almost started writing a tool for that, because nothing else I found supports arrays and composite types. Now let's hope DuckDB does support that :)
by exyi 4y ago
Exactly, I almost started writing a tool for that, because nothing else I found supports arrays and composite types. Now let's hope DuckDB does support that :)
If you don't use arrays and composites, Spark should be able to do it, right?
- 1egg0myegg0 4y agoYes, DuckDB supports writing lists and structs to Parquet! https://github.com/duckdb/duckdb/pull/2832 https://github.com/duckdb/duckdb/pull/2832 Does that help or do you have any other questions?
- exyi 4y agoAwesome. However, the postgres_scanner has problems with jsonb, it won't even connect the database which contains those :/
- 1egg0myegg0 4y agoThank you for filing a bug, we will have a look at that I'm sure!
- exyi 4y agoIt's more of a feature request. Thank you :)