3 ms·

I've never looked at redpanda, but kafka absolutely does not. Kafka uses mmapped files and the page cache to manage durable writes. You can configure it to fsyn

I've never looked at redpanda, but kafka absolutely does not. Kafka uses mmapped files and the page cache to manage durable writes. You can configure it to fsync if you like.

mxey 11mo ago
If I don’t actually want durable and consistent data, I could also turn off fsync in Postgres …
- mrkeen 11mo ago
  The tradeoff here is that Kafka will still work perfectly if one of its instances goes down. (Or you take it down, for upgrades, etc.) Can you lose one Postgres instance?
  - zozbot234 11mo ago
    AIUI Postgres has high-availability out of the box, so it's not a big deal to "lose" one as long as a secondary can take over.
    - mxey 11mo ago
      Only replication is built-in, you need to add a cluster manager like Patroni to make it highly-available.