9 ms·

Many engineers discover a need of rate limiters the hard way :-). I just wonder, do you use rate limiters just for external API or also for internal API of you

• ptarjan 10y ago
  We do have rate limits on some of our more crucial services (we don't use microservices per se, more like macroservices). One difference for internal rate limits is we set alerts whenever they fire so that we can track down the client and see what they were doing. It is much easier to do that when you own both sides of the pipe.
• fredliu 10y ago
  I think since it's internal services, you control both the client and server side. Applying back-pressure would be a good alternative than just using rate limiter on the server end and let your client just flood away your internal service interfaces.
• hibikir 10y ago
  A big percentage of our internal services are near-real-time asynchronous event consumers. Writing a consumer is not all that different than writing a service. For events and consumers we have mechanisms that serve similar functions as API rate limiting, but they have a different shape. So the answer is probably a yes?
  • deleted 10y ago
    [deleted]