3 ms·
This is typically referred to as backpressure. For example a failure can break your messaging infrastructure and cause producer buffers to fill up and fail caus
by pram 5y ago
This is typically referred to as backpressure. For example a failure can break your messaging infrastructure and cause producer buffers to fill up and fail causing data loss. Once the infra comes back online it can essentially be DDoSed by all the services trying to clear their buffers/reconnect/resync
You can mitigate it with stuff like exponential back off (from the client/producer side) or rate limiting. It’s a complicated problem though.