Exactly. In those cases, getting 100 reqs/sec or 1000 reqs/s probably means you're getting DOS'd. Any rate limiter is enough. Or you could still use multiple i

Exactly. In those cases, getting 100 reqs/sec or 1000 reqs/s probably means you're getting DOS'd. Any rate limiter is enough. Or you could still use multiple instances, not for scaling but for patching without downtime and so on. Availability can be way more important than sheer performance or number of concurrent requests.