2 ms·
> Practically speaking the only way to really reduce latency to the minimum of the software is idle resources awaiting work. Indeed. This is similar to the buf
by magicalhippo 4y ago
> Practically speaking the only way to really reduce latency to the minimum of the software is idle resources awaiting work.
Indeed. This is similar to the buffer-bloat situation, where limiting your download speed to 90-95% of max capacity will allow for both high throughput and acceptable low latency.
Maybe the system could tune itself in an audio compressor[1] like attack-release style, where it would never go above say 95% utilization (random number), but could dynamically lower it if low-latency requests suffer, then slowly raising it as low-latency requests tapers off.
[1]: https://themixingtips.com/what-is-compressor-attack-and-release/ https://themixingtips.com/what-is-compressor-attack-and-rele...