4 ms·
Now we need to write parquet files from Postgres. Its essentially what do we need to do for end to end solution with PG by leveraging extensions
by nitinreddy88 3y ago
Now we need to write parquet files from Postgres. Its essentially what do we need to do for end to end solution with PG by leveraging extensions
- tehlike 3y agohttps://github.com/adjust/parquet_fdw https://github.com/adjust/parquet_fdw
- nitinreddy88 3y agoIt doesn't support writing data. One has to hookup worker to write data efficiently to parquet on regular basis or some fashion using PG. Its like bits and pieces everywhere but didnt create end to end usecase
- ibotty 3y agoThis can be done using duckdb_fdw. It needs one additional copy though. You insert into the duckdb table and then export from duckdb using duckdb_execute.