4 ms·
HN: our team has been working on an advanced API queue/load management system called Aperture[0]. It has following capabilities - 1. Limits concurrency based o
by gillh 4y ago
HN: our team has been working on an advanced API queue/load management system called Aperture[0]. It has following capabilities -
1. Limits concurrency based on latency gradient or queue depths etc.
2. Weighted fair queueing scheduler - prioritized load shedding based on workload priorities and latency estimation.
Anyone interested in Little’s Law, token buckets, network schedulers, control theory (PID controllers) should definitely check it out! [1]
[0]: https://github.com/fluxninja/aperture https://github.com/fluxninja/aperture
[1]: https://docs.fluxninja.com/ https://docs.fluxninja.com/