4 ms·

Or a bit more 'web scale's use wal_insert and the outbox pattern to transactionally replicate events to a messaging system (Kafka etc).

• lyu07282 3y ago
  you can also just use a CDC to import from Postgres into Kafka using Debezium and then on the other end Kafka Connect to write into Elasticsearch, no need to write any code at all with this setup ymmv ofc
  • paulryanrogers 3y ago
    Sounds like a lot of moving parts though, unless the team is already familiar with maintaining all those parts
    • lyu07282 3y ago
      if you already use Kafka anyway its a valid solution, I wouldn't introduce Kafka for this obviously. Also Kafka Connect and Debezium are mature well maintained open source projects in case that wasn't clear enough. https://debezium.io/ https://debezium.io/ https://docs.confluent.io/platform/current/connect/index.html https://docs.confluent.io/platform/current/connect/index.htm...