3 ms·
Yes that's pretty much what we're going for. I'm less familiar with DynamoDB Streams but we're taking inspiration from Postgres triggers https://www.postgresql.
by matlin 3y ago
Yes that's pretty much what we're going for. I'm less familiar with DynamoDB Streams but we're taking inspiration from Postgres triggers https://www.postgresql.org/docs/current/sql-createtrigger.html https://www.postgresql.org/docs/current/sql-createtrigger.ht...
- jitl 3y agoI recommend having a pre-built integration that dumps all changes to the database in a Debezium CDC compatible format. Not sure how you'd normalize Triplit changes into Debezium updates, but something to think about. Debezium CDC format lets you pipe changes from one DB into a stream system like Kafka, and then out of Kafka into another DB on the other end. It's handy. https://debezium.io/documentation/reference/2.5/transformations/event-flattening.html#new-record-state-extraction https://debezium.io/documentation/reference/2.5/transformati... For example, the original method for connecting Postgres to Materialize.com was using a Debezium stream: https://materialize.com/docs/ingest-data/cdc-postgres-kafka-debezium/ https://materialize.com/docs/ingest-data/cdc-postgres-kafka-...
- matlin 3y agoThat's a great pointer seems like a many birds single stone solution!