10 ms·
Yes, but I think it's a revelation to many people that things like this map to queueing. Literally _everything_ related to performance is queueing, but we use d
by amw-zero 2y ago
Yes, but I think it's a revelation to many people that things like this map to queueing. Literally _everything_ related to performance is queueing, but we use different words for different scenarios, like "contention."
- loeg 2y ago> Literally _everything_ related to performance is queueing Well, _scaling_ is queuing. But other things: cache hit rates, data packing efficiency, efficient use of hardware intrinsics, etc, don't relate to queuing.
- amw-zero 2y agoA queue is: * An arrival rate of requests * A processing time for each request * A corresponding queue length when a new request comes in before the current one is done being processed. So anything that affects processing time affects queueing. Cache hit rates, data packing, etc., all affect processing time, but processing time is in the context of a queue.
- unification_fan 2y agoHow is the concept of algorithmic complexity analogous to queuing?
- amw-zero 2y agoYour whole system is a queue. Requests come in, are processed, and some output is given. Algorithmic complexity affects the processing time of each request / task. Knowing the latency distribution is crucial in understanding the queueing characteristics of the system, and the algorithmic complexity will greatly affect that distribution.