Another (big company strategy) is deadlines: https://cloud.google.com/appengine/docs/standard/python/how-requests-are-handled#specifying_a_request_deadline htt

Another (big company strategy) is deadlines: https://cloud.google.com/appengine/docs/standard/python/how-requests-are-handled#specifying_a_request_deadline https://cloud.google.com/appengine/docs/standard/python/how-... The idea is that at the time a request is made, you have a pretty good idea of the maximum amount of time it can take, so you attach that as metadata with the request. If any service anywhere in infrastructure sees that a request has taken more than its budgeted time, it has permission to immediately stop handling that request and return an error.