3 ms·
Yes, but I imagined that you’d have a ceiling for rolling average / token bucket over a sensible time window, with two limits: - a soft alert limit, which you
by klabb3 2y ago
Yes, but I imagined that you’d have a ceiling for rolling average / token bucket over a sensible time window, with two limits:
- a soft alert limit, which you set to the threshold of “hmm something is wrong but we’ll bear the cost until we figure it out”
- a hard limit which fails until more tokens trickle back in, without shutting down service
I really don’t want to rely on forgiveness, it’s just encouraging reckless behavior and submitting to the incomprehensibility of cloud pricing.
Everyone wants these limits, why not design products with that in mind from the get go? It feels like such an afterthought