3 ms·

How does this replicate Postgres data? I glanced at the code and saw that it exports to a CSV file then writes out an Iceberg table for an initial snapshot--doe

How does this replicate Postgres data? I glanced at the code and saw that it exports to a CSV file then writes out an Iceberg table for an initial snapshot--does it use Postgres logical replication?

exAspArk 2y ago
Full table re-syncing is our initial solution. Using Postgres logical replication is next on our roadmap!
- oulipo 2y ago
  So if we have a very large table, it means each time I replicate (how often does that happen?) it needs to rewrite the entire table and upload it to S3, right?