3 ms·
Biggest thing is that we find ourselves needing to retain this data for more than initial delivery and also for use cases where we want to use the data more lik
by addisonj 7y ago
Biggest thing is that we find ourselves needing to retain this data for more than initial delivery and also for use cases where we want to use the data more like a log and need ordering guarantees. It isn't just our current SQS use cases, it is being able to have one tech that does SQS like stuff and Kinesis like stuff in one place
- tybit 7y agoWhen we ran into a similar use case we went with writing to S3 and using S3 SNS notifications and consumers could subscribe their SQS queues to that. Having said that, assuming Pulsar has a similar feature to Kafkas log compaction I can definitely see the appeal! Also the fact that SQS Fifo doesn’t integrate with this setup is super annoying. Edit: Log compaction not key compaction