4 ms·
Logical replication row filtering is a much better alternative to the ship and drop approach.
by imbradn 1y ago
Logical replication row filtering is a much better alternative to the ship and drop approach.
- levkk 1y agoInteresting. I've been thinking about it as well. I wrote some code to prototype it here: https://github.com/pgdogdev/pgdog/blob/main/pgdog/src/backend/replication/buffer.rs https://github.com/pgdogdev/pgdog/blob/main/pgdog/src/backen...
- imbradn 1y agoWe used it to shard a database at Instacart after your time instead of the “replicate everything and drop the data on the shard approach”. That combined with dropping all the indexes (minus the primary key) worked well for the data copy/initial sharding.
- levkk 1y agoThat's good to know. Don't hesitate to reach out if you ever want to chat about this stuff. My email: lev@pgdog.dev