Think how you can limit the load, but have as few users affected, as possible. And I mean users that make requests and are quick to leave if latency feels high

Think how you can limit the load, but have as few users affected, as possible. And I mean users that make requests and are quick to leave if latency feels high for them, not system users. System doesn't make limiting decisions on per request basis to be useful for this.