3 ms·
Architecturally, the idea of discarding duplicate messages from a queue is: queue -> parser -> queue Discarding duplicate messages is a piece of business lo
by brudgers 9y ago
Architecturally, the idea of discarding duplicate messages from a queue is:
queue -> parser -> queue
Discarding duplicate messages is a piece of business logic. The parser could be as simple as a hashmap/dictionary or bloom filter that emits or does not emit the message based on the selected criteria.
This is a case where I like the idea of Unix pipes and where I might think in terms of log data structures rather than queues. Your mileage may vary.
Good luck.