3 ms·
Pulsar docs indicate "millions" of topics but IDK what 50 million would look like but from what I know I would be a bit nervous about it :) It might be worth c
by addisonj 7y ago
Pulsar docs indicate "millions" of topics but IDK what 50 million would look like but from what I know I would be a bit nervous about it :)
It might be worth chatting with Pulsar devs on their slack community (https://apache-pulsar.herokuapp.com/ https://apache-pulsar.herokuapp.com/).
Most commonly what I hear people doing for this is either one of two approaches (or a combination of both):
- encrypt the user data and delete the key, eventually the user data will get removed
- regularly compact the topic (pulsar has a compaction feature) and write in a tombstone record which will remove any user data after compaction