3 ms·
You should really check out the recent Aperture[1] project on GitHub that applies all these ideas in practice to protect services from cascading failures. 1. A
by gillh 4y ago
You should really check out the recent Aperture[1] project on GitHub that applies all these ideas in practice to protect services from cascading failures.
1. Aperture automatically detects queue buildup based on metrics such as latency.
2. Adjusts the concurrency on a service.
3. Weighted Fair Scheduling of workloads (i.e. APIs) based on their labels.
[1] https://github.com/fluxninja/aperture https://github.com/fluxninja/aperture
- kqr 4y agoI'm confused the decision would be based on latency, which is somewhat lagging. Queue length would seem more efficient, since it's leading.
- gillh 4y agoThe metric and the control circuit is configurable/programmable. [1] https://github.com/fluxninja/aperture/blob/main/blueprints/blueprints/latency-gradient/example/gen/policies/example.yaml https://github.com/fluxninja/aperture/blob/main/blueprints/b...