3 ms·
Intuitively, there is a threshold above which increasing the number of threads decreases throughput (for example reaching your total number of cores if you are
by remram 4y ago
Intuitively, there is a threshold above which increasing the number of threads decreases throughput (for example reaching your total number of cores if you are CPU-bound, might be a different number for different workloads). It would be nice to have the controller try to find that number, this PID approach just tries to scale more if there's more input.
It might be more suited to infinitely-scalable situations like cloud VMs, where you are trying to optimize money spent.
- naasking 4y ago> It would be nice to have the controller try to find that number, this PID approach just tries to scale more if there's more input. Right, it should base the feedback on throughput measures instead. If throughput starts dropping, then the threadpool is overcommitted, and should scale back. I believe the SEDA papers mentioned in the README discusses this as backpressure.