3 ms·
> So the only message passing between your rust actors is via SQS or such? It's S3 -> SNS -> SQS -> Lambda This gives me: * Persistent events on s3, for repl
by staticassertion 8y ago
> So the only message passing between your rust actors is via SQS or such?
It's S3 -> SNS -> SQS -> Lambda
This gives me:
* Persistent events on s3, for replayability
* Multiconsumer for SNS
* Dead letters, retries, etc via SQS
Maybe from a latency perspective this is slow, but my system can tolerate latency at the level of minutes, so I'm really doubtful that my messaging system will matter.
Most time is spent downloading payloads in S3 as far as I know. I batch up and compress proto events to optimize this.
I haven't tried scaling out my system but I'm confident that message passing is the least of my concerns.