3 ms·
In Postgres land bloat refers to dead tuples that are left in place during certain operations and need to be vacuumed later. It’s challenging to write a queue
by pierrekin 6mo ago
In Postgres land bloat refers to dead tuples that are left in place during certain operations and need to be vacuumed later.
It’s challenging to write a queue that doesn’t create bloat, hence why this project is citing it as a feature.
- what 6mo agoCan’t you just partition the table by time (or whatever) and drop old partitions and not worry about vacuuming? Why do you need to keep around completed jobs forever?
- pierrekin 6mo agoYes you can, and at the risk of sounding a little snarky; if you do something like that and then release it as open source, people may even discuss it on HN!
- victorbjorklund 6mo agoWhat about old failed jobs? You might wanna keep them around? And maybe you have retries that have a backoff.
- perrygeo 6mo agoIf you're looking for kafka-like semantics, you might want to keep messages around. Your temporal partition idea is spot on. But instead of dropping old partitions, you can instead archive them.